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1  Administrative  Information 

Funding  for  this  project  has  come  from  a  variety  of  model  test  and  full  scale  sea 
trials  programs.  The  High  Volume  Data  Analysis  Suite  (HVDAS)  has  been  used 
to  speed  the  data  analysis  of  the  DD-21  and  HSS  model  tests  as  well  as  the  data 
analysis  of  the  full  scale  sea  trials  of  the  Incat  HSV-X1  and  RV  Triton. 

HVDAS  is  not  a  specific  deliverable;  it  is  a  tool  developed  from  project  funds 
to  increase  the  speed  and  quality  of  data  analysis. 


1.1  DD-21  Hull  Form  Hydrodynamic  Loads  Model  Testing 

This  analysis  was  performed  by  the  Structures  and  Composites  Department  (Code 
65)  of  the  Survivability,  Structures  and  Materials  Directorate  at  the  Naval  Surface 
Warfare  Center,  Carderock  Division  (NSWCCD).  The  work  was  sponsored  by 
Naval  Sea  Systems  Command,  SEA  05H  and  the  DD-21  program  office,  PMS 
500,  under  program  element  0603564N,  job  order  number  1-5500-1 14.  Supple¬ 
mental  funding  was  provided  by  the  Office  of  Naval  Research  under  job  order 
number  1-5500-159.  This  analysis  was  funded  in  FY00  under  program  element 
0604300N,  job  order  number  1-6530-456. 

1.2  High  Speed  Sea  Lift  (HSS)  Hydrodynamic  Loads  Model 
Testing 

Hydrodynamic  loads  testing  was  completed  on  a  segmented  High  Speed  Sea  Lift 
(HSS)  Model  5594,  scaled  ratio  1:45,  containing  six  shell  sections  connected 
using  a  calibrated  backspline  with  instrumentation  to  measure  primary  and  sec¬ 
ondary  hull  girder  loading.  Similar  to  a  trimaran,  the  extremely  long  slender 
center  hull  is  stabilized  by  relatively  short  side  hulls  attached  at  an  extreme  aft 
location  aligning  all  three  hulls  at  the  transom.  This  is  part  of  a  Navy  program 
evaluating  the  structural  design  of  a  lightweight  high-speed  hull  form  as  part  of 
the  High  Speed  Sea  Lift  program;  program  element  0603564N.  Irregular  wave 
experiments  have  been  completed  to  evaluate  primary  and  secondary  structural 
loads  and  seakeeping  performance.  Model  testing  was  performed  at  the  NSWC 
Harold  Saunders  Maneuvering  and  Seakeeping  (MASK)  facility  in  June  of  2002 
and  ended  with  irregular  wave  testing  in  July  2002  on  carriage  two  of  the  David 
Taylor  Model  Basin. 
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1.3  HSV-X1  Seakeeping  and  Structural  Full  Scale  Trials 

The  USNS  Joint  Venture  HSV-X1  is  an  aluminum  catamaran  built  by  Incat.  The 
HSV  is  produced  commercially  as  a  high  speed  ferry.  Sea  trials  were  carried  out 
in  2001  and  2002  and  involved  trans  Atlantic  crossings,  loading  and  unloading 
operations,  helicopter  landing  and  take  off,  and  high  speed  combat  support  sim¬ 
ulations.  Funding  was  provided  by  two  separate  divisions  of  the  Office  of  Naval 
Research.  FY01  -  02:  Expeditionary  Logistics  Future  Naval  Capabilities  (FNC) 
High  Speed  Shuttle  Product  Line,  program  element  060XXXXN,  job  order  num¬ 
ber  01-2820-040.  FY02  -  03:  Swampworks,  program  element  0603758N,  job 
order  number  02-5500- 1 95. 

1.4  RV  Triton  Seakeeping  and  Structural  Full  Scale  Trials 

The  RV  Triton  is  a  steel  trimaran  demonstrator  research  vessel  built  by  Vosper 
Thornycroft  in  the  UK.  The  sea  trials  were  conducted  in  2001  and  2002  and  in¬ 
volved  trans  Atlantic  crossings,  speed  and  powering  maneuvers,  seakeeping  sea 
trials,  and  structural  sea  trials.  Funding  was  provided  by  a  memorandum  of  un¬ 
derstanding  (MOU)  contract  between  the  US  and  UK.  The  MOU  contract  number 
is  N0002499MD1 1 140.  The  data  reduction  and  analysis  began  in  June  of  2002 
and  continues  through  September  of  2003.  As  of  2003,  this  is  the  largest  full  scale 
sea  trials  data  analysis  project  ever  attempted.  The  sea  trials  team  recorded  50  star 
patterns,  which  consist  of  10  different  headings,  in  varying  sea  conditions.  The 
largest  peak  wave  amplitude  experienced  during  the  trials  was  9.7  meters  or  32 
feet. 
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3  Introduction 

3.1  How  To  Use  This  Document 

•  Read  this  document  in  its  entirety  before  performing  any  of  the  procedures. 

•  Check,  Check,  and  Re-Check  modifications  or  deletions  of  data  and  config¬ 
uration  files. 

•  Back  up  your  data  before  doing  anything  else  mentioned  in  this  document. 

•  Back  up  your  results  before  modifying  or  deleting  data  or  configuration 
files. 

3.2  Assumptions  Made  In  This  Document 

The  user  has  knowledge  of  and  experience  in: 

•  Time  domain  statistical  analysis 

•  Frequency  domain  statistical  analysis 

•  Linear  transfer  functions 

•  Discrete  amplitude  statistical  analysis 

•  Weibull  distribution  statistics 

•  Binary  and  ASCII  multiple-channel  data  files 

•  Format  and  location  of  the  data  files  to  be  analyzed 

•  Finite  impulse  response  filtering 

•  Linux  operating  system  and  a  Unix  shell 

The  user’s  analysis  computer  and  user  account  have: 

•  The  Local  Area  Multicomputer  (LAM)  implementation  of  Message  Passing 
Interface  (MPI)  installed 

•  The  core  or  core  plus  version  of  the  Vector  Signal  Image  Processing  Library 
(VSIPL)  installed 
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•  Appropriate  permissions  to  run  MPI  programs 

•  Appropriate  permissions  to  access  the  data  files  to  be  analyzed 

3.3  What  Does  HVDAS  Do? 

HVDAS  is  a  collection  of  data  analysis  software  algorithms  designed  to  run  in 
parallel  on  Linux  clusters.  HVDAS  consists  of  the  hvdalibrary  and  hvdas  exe¬ 
cutable.  The  hvdas  executable  has  command  line  flags  for  MMM,  PSD,  RAO, 
and  Weibull  analysis.  Each  of  these  analysis  algorithms  is  designed  to  run  as  an 
automated  process  to  analyze  data  in  bulk.  HVDAS  requires  the  LAM-MPI  li¬ 
brary  and  VSIPL  to  compile  from  source  code.  Information  about  obtaining  and 
installing  these  software  packages  can  be  found  at  http://www.lam-mpi.org  and 
http://www.vsipl.org. 

HVDALibrary  contains  most  of  the  code  that  is  common  to  the  different  analy¬ 
sis  algorithms.  HVDALibrary  also  contains  most  of  the  complex  reusable  analysis 
code  used  by  each  of  the  different  analysis  algorithms. 

“hvdas  -mmm”  computes  basic  time  domain  statistics  including  mean,  max, 
min,  max-mean,  min-mean,  absolute  range,  maximum  peak-to-peak  amplitude, 
standard  deviation,  and  kurtosis.  MMM  analysis  can  also  convert  data  file  formats 
and  compute  virtual  channel  data  files. 

“hvdas  -psd”  computes  the  Power  Spectral  Density!  1 , 2]  of  selected  data  chan¬ 
nels,  using  the  Finite  Fourier  Transform  Method  Segment  Averaging  Method 
(PSDFFTMSAM[1]). 

“hvdas  -rao”  computes  the  Square  Root  Response  Amplitude  Operator,  which 

is  computed  by  \/RAO  =yj pgoFFrA/s-iA/(^r  which  is  simP1y  the  frequency 
based  square  root  of  the  ratio  of  two  power  spectral  densities.  When  analyzing 
surface  ship  structures,  the  RAO  can  calculate  and  provide  ship  response  per  unit 
of  input  wave  height. 

“hvdas  -weibull”  computationally  estimates  Weibull [16]  distribution  statistics 
on  selected  data  channel  amplitudes.  You  can  choose  the  method  of  Weibull  com¬ 
putation  of  either  2-Parameter  Linear  Regression,  2-Parameter  Moment  Method, 
3-Parameter  Linear  Regression,  or  3-Parameter  Moment  Method.  These  statistics 
are  useful  for  calculating  maximum  lifetime  loads. 

“hvdas  -convertdata”  converts,  scales,  filters,  or  computes  virtual  channels  and 
saves  the  output  as  tab-delimited  ASCII  text. 

HVDAS  provides  the  ability  to  apply  scale  factors,  subtract  initial  condition 
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zero  values,  smooth,  Finite  Impulse  Response[7]  (FIR)  filter,  select  data  files, 
select  channels,  name  channels,  name  conditions,  select  output  locations,  and  read 
multiple  data  file  formats.  The  algorithms  in  HVDAS  are  not  in  any  way  restricted 
to  ship  structure  data. 

4  What  Does  “hvdas  -mmm”  Do? 

“hvdas  -mmm”  computes  Mean  Maximum  Minimum  (MMM)  time  domain  statis¬ 
tics  and  is  designed  to  reduce  raw  test  data  into  a  manageable  spreadsheet  of  time 
domain  statistical  information.  The  user  can  configure  the  program  to  handle  nu¬ 
merous  filter  types,  data  types,  file  formats,  and  test  configurations.  This  software 
will  compute  the  Mean,  Max,  Min,  ( Maximum  —  Mean),  ( Minimum  —  Mean), 
Range,  Maximum  Peak-to-Peak,  Standard  Deviation,  Kurtosis,  Mean  Crossings, 
and  These  statistics  are  calculated  for  each  of  five  possible 

filter  states  on  selected  channels,  files,  and  conditions.  The  user  has  the  option 
of  subtracting  an  initial  zero  condition  value  from  every  channel  of  data  before 
analysis. 

The  results  are  also  summarized  by  filter  state  and  condition.  The  summary  file 
contains  weighted  averages  of  statistics  that  do  not  require  a  discrete  maximum  or 
minimum  value. 


4.1  Mean 

The  Sample  Mean[2]  is  calculated  by  x  —  jj  Y<iL\  %i-  The  Sample  Mean  x  is  an 
unbiased  estimator  of  population  mean. 

4.2  Max 

The  Max  is  the  maximum  value  that  occurs  in  the  time  history. 

4.3  Min 

The  Min  is  the  minimum  value  that  occurs  in  the  time  history. 
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4.4  Maximum-Mean 

The  Maximum-Mean  is  computed  by  subtracting  the  mean  of  the  time  history 
from  the  maximum  value  in  the  time  history. 

4.5  Minimum-Mean 

The  Minimum-Mean  is  computed  by  subtracting  the  mean  of  the  time  history  from 
the  minimum  value  in  the  time  history. 

4.6  Range 

Range  refers  to  the  absolute  range  of  the  time  history  data.  If  the  maximum  value 
occurs  after  the  minimum  value  in  the  time  history,  the  range  is  computed  by  sub¬ 
tracting  the  minimum  value  of  the  time  history  from  the  maximum  value  of  the 
time  history.  If  the  minimum  value  occurs  after  the  maximum  value,  the  range  is 
computed  by  subtracting  the  maximum  value  of  the  time  history  from  the  mini¬ 
mum  value  of  the  time  history.  This  can  be  useful  when  analyzing  non-sinusoidal 
data,  where  a  positive  range  value  could  indicate  generally  increasing  data  over 
time,  while  a  negative  range  could  indicate  generally  decreasing  data  over  time. 
For  sinusoidal  data,  the  sign  of  the  range  indicates  whether  the  minimum  or  the 
maximum  value  occurred  first  in  the  time  history,  which  may  or  may  not  be  useful. 

4.7  Maximum  Peak-to-Peak 

Maximum  Peak-to-Peak  is  the  amplitude  of  the  largest  half  cycle  oscillation  in  the 
time  history  about  the  mean  of  the  time  history. 

4.8  Variance 

The  Sample  Variance[2]  is  calculated  by  a2  =  Var(xi . . .  x^)  =  TljLi (xj  ~ 
x )2.  The  summation  is  divided  by  N  —  1  because  that  makes  the  sample  variance 
an  unbiased  estimator  for  the  population  variance  since  the  mean  of  the  population 
is  estimated  from  the  sample  itself. 
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RV  Triton  VSTR116 


Figure  1:  RV  Triton  MMM  Standard  Deviation  Trend 


4.9  Standard  Deviation 

The  Standard  Deviation[2]  is  calculated  by  o  =  Taking  the  square  root  of 
the  unbiased  sample  variance  yields  an  unbiased  estimator,  the  standard  deviation. 
Figure  1  shows  max-mean  as  a  function  of  standard  deviation  for  strain  due  to 
vertical  bending  on  the  RV  Triton. 

4.10  Kurtosis 

The  Kurtosis[4,  5]  is  calculated  by  Kurt(xx . .  .xn)  =  i  This 

method  is  also  known  as  the  Pearson  Kurtosis,  which  defines  the  Kurtosis  of  a 
normal  distribution  as  3.  Division  by  N  is  required  because  all  two  parameter 
distributions  are  completely  defined  by  the  mean  and  the  variance,  which  have 
already  taken  the  degrees  of  freedom  into  account  by  dividing  by  N  and  N- 1  re¬ 
spectively. 

The  Excess,  defined  as  Excess(xx . . .  xn)  =  T.  -  3,  is  not  the 

Kurtosis.  The  Excess,  or  Fisher  Kurtosis,  defines  the  Kurtosis  of  a  normal  distri¬ 
bution  as  0,  which  is  not  the  intended  calculation  and  is  not  calculated  by  FlVDAS. 


17 


NSWCCD-65-TR-2003/02 


Figure  2:  RV  Triton  Filtered  Time  History  Comparison 

4.11  Mean  Crossings 

Mean  Crossings  is  the  number  of  times  the  time  history  data  oscillates  about  its 
mean. 

4.12  (Maximum-Mean)/(Standard  Deviation) 

This  value  is  computed  by  subtracting  the  mean  from  the  maximum  value  in  the 
time  history  and  then  dividing  by  the  standard  deviation  of  the  time  history.  This 
value  is  a  good  check  to  quantify  the  severity  of  slamming,  noise,  or  drop-outs  in 
the  data.  This  value  defines  how  many  standard  deviations  the  maximum  value  is 
from  the  mean. 

4.13  Filtering,  Smoothing,  and  Zero  Subtraction 

Figure  2  shows  raw,  low-pass  FIR,  and  high-pass  FIR  filtered  versions  of  a  time 
history,  which  was  taken  from  RV  Triton  sea  trials.  The  filters  were  designed  using 
Wave  Metrics  IGOR  Pro  IFDL  and  the  time  histories  were  filtered  with  HVDAS. 
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RV  Triton  Sea  State  6  IS  Knots  Head  Seas 


Figure  3:  RV  Triton  PSD  0  to  4  Hz 

5  What  Does  “hvdas  -psd”  Do? 

“hvdas  -psd”  computes  power  spectral  density  (PSD)  frequency  domain  statistics 
and  is  designed  to  reduce  raw  test  data  into  a  manageable  spreadsheet  of  frequency 
domain  information.  The  user  can  configure  the  program  to  handle  numerous 
filter  types,  data  types,  file  formats,  and  test  configurations.  These  statistics  are 
calculated  for  either  raw  or  low-pass  filter  states  on  selected  channels,  files,  and 
conditions. 

The  results  are  also  summarized  by  filter  state  and  condition.  The  summary 
file  contains  weighted  averages  of  spectral  ordinates. 

Figure  3  shows  an  example  PSD  from  the  RV  Triton  sea  trials  data.  The  PSD 
has  been  plotted  from  0  to  4  Hz,  which  encompasses  wave-induced  energy  and 
first  mode  vibratory  response,  but  the  first  mode  energy  is  so  small  it  is  not  visible 
on  the  current  y-axis  scale. 

Figure  4  shows  the  same  PSD  plotted  in  from  0  to  0.6  Hz,  which  shows  the 
wave-induced  energy  more  clearly. 

Figure  5  shows  the  same  PSD  plotted  in  from  2  to  4  Hz,  which  shows  us  the 
first  mode  vibratory  response  to  the  wave  energy.  The  peak  first  mode  frequency 
of  2.91  Hz  is  clearly  visible;  this  is  the  natural  frequency  of  the  RV  Triton  in  the 
vertical  longitudinal  plane. 
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Figure  4:  RV  Triton  PSD  0  to  0.6  Hz 


Figure  5:  RV  Triton  PSD  2  to  4  Hz 
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5.1  Power  Spectral  Density  Finite  Fourier  Transform  Method 
Segment  Averaging  Method 

This  software  will  compute  the  power  spectral  density[l,  6,  2],  which  has  user 
selectable  resolution  and  frequency  content. 

The  power  spectra  in  this  analysis  use  the  Power  Spectral  Density  Finite  Fourier 
Transform  Method  Segment  Averaging  Method  (PSDFFTMSAM[1])  with  a  50% 
overlap. 

The  PSDFFTMSAM  computes  the  Power  Spectral  Density  using  the  Finite 
Fourier  Transform  Method  (PSDFFTM)  on  a  number  of  segments  of  the  original 
data  channel,  which  have  the  mean  of  each  segment  subtracted  out.  The  local 
segment  mean  subtraction  prevents  extremely  low  frequencies  from  aliasing  to  dc 
in  the  output  spectrum.  The  output  PSD  will  be  Se9men^Len9th  _|_  \  points  long. 
Each  segment  PSD  is  summed  and  divided  by  the  total  number  of  segments  in 
the  input  data  channel,  which  includes  the  overlap.  This  summation  and  division 
results  in  an  average  PSD  for  the  data  run. 

The  computed  PSDFFTM  uses  I-Skipping  to  achieve  greater  resolution.  The 
amount  of  I-Skip  and  the  PSD  segment  length  are  computed  automatically  based 
on  the  Original  Sample  Rate  of  the  data,  Highest  Frequency  of  Interest  (HFI) 
of  the  output  PSD,  amount  of  Oversampling  of  the  HFI,  and  the  Target  Delta 
Frequency  of  the  output  PSD,  which  are  all  selectable  by  the  user.  The  I-Skipped 
data  vector  is  computed  by  averaging  the  point  to  be  extracted  with  the  points  to 
be  skipped,  which  eliminates  high  frequency  aliasing. 

If  any  single  data  channel  contains  too  few  data  points  to  compute  the  PSD 
with  the  desired  resolution  and  frequency  content,  that  channel  will  be  repeated 
and  concatenated  with  itself  until  enough  points  exist  to  perform  the  PSD  compu¬ 
tations.  This  method  assumes  each  short  data  run  would  continue  with  identical 
frequency  content  until  enough  data  existed  to  compute  the  desired  PSD.  Any  dis¬ 
continuities  exist  as  frequencies  above  the  Nyquist  frequency,  which  is  half  of  the 
sample  rate,  and  will  not  show  up  in  the  output  PSD. 

The  Finite  Fourier  Transform  Method  (FFTM)  of  computing  the  PSD  assumes 
that  h  (t)  =  ReallnputDataV ector  and  that 

H  (/)  =  FourierTransform(h(t )).  The  PSDFFTM  is  computed  by 

PSDFFTM  (/)  =  2*  \  H  (/)  |2.  The  FT  is  performed  on  the  original  data 
vector  segment.  We  use  the  real  and  imaginary  parts  of  the  FT  to  create  a  real 
magnitude  squared  FT.  We  then  multiply  by  two  to  account  for  the  one  sided 
spectrum,  then  divide  by  the  input  data  vector  size  and  the  sample  rate  to  scale 
the  power  spectrum.  This  last  step  needs  to  be  done  because  of  the  FT  implemen- 
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tation  we  use.  The  area  under  the  final  PSD  is  the  variance  of  the  original  time 
history.  The  corresponding  frequency  of  each  PSD  magnitude  squared  is  calcu¬ 
lated  using  the  number  of  PSD  points,  the  number  of  the  current  point,  and  the 
Nyquist  frequency,  which  is  half  of  the  sample  rate. 

6  What  Does  “hvdas  -rao”  Do? 

“hvdas  -rao”  computes  Square  Root  Response  Amplitude  Operator  (RAO)  and 
is  designed  to  reduce  raw  test  data  into  a  manageable  spreadsheet  of  frequency 
domain  information.  The  user  can  configure  the  program  to  handle  numerous 
filter  types,  data  types,  file  formats,  and  test  configurations.  RAOs  are  calculated 
for  either  raw  or  low-pass  filter  states  on  selected  channels,  files,  and  conditions. 

The  results  are  also  summarized  by  filter  state  and  condition.  The  summary 
file  contains  weighted  averages  of  RAO  ordinates. 

Figure  6  shows  an  RAO  from  the  RV  Triton  sea  trials  in  the  Sea  State  4,  10 
knots,  head  seas  condition.  You  can  see  that,  at  0.3  Hz,  the  strain,  due  to  vertical 
longitudinal  bending,  of  the  RV  Triton  has  the  largest  response  to  input  wave 
height.  The  max  valid  RAO  encounter  frequency  for  the  RV  Triton  is  probably 
0.7  to  0.8  Hz.  The  true  maximum  linear  response  to  wave  energy  occurs  close  to 
0.3  Hz  encounter.  After  0.8  Hz  the  response  is  nonlinear  vibration  and  the  RAO 
transfer  function  is  not  useful.  Because  of  this  behavior,  it  is  necessary  to  also  look 
at  structural  and  wave  height  PSDs  separately  to  determine  valid  RAO  frequency 
ranges. 


6.1  Response  Amplitude  Operation  Computation 


This  software  will  compute  the  Square  Root  RAO  using  two  PSDs,  which  have 
user-selectable  resolution  and  frequency  content. 

The  power  spectra  computed  in  this  analysis  utilize  the  Power  Spectral  Density 
Finite  Fourier  Transform  Method  Segment  Averaging  Method  (PSDFFTMSAM) 
with  a  50%  overlap,  as  described  in  the  PSD  analysis  section. 

An  RAO  is  simply  the  frequency  by  frequency  ratio  of  a  spectra  to  an  ex¬ 
citation  spectra,  (^RAdf  =  »  where  the  RA0 

units  depend  on  the  units  of  the  input  data  channels.  In  ship  structures,  the 

( VRAO )2  =  which  y»elds  results  in  terms  of 

ship  response  per  unit  of  wave  height,  but  the  output  transfer  function  depends 
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RV  Triton  Example  Root  RAO 


Figure  6:  RV  Triton  RAO  Example  0  to  0.8  Hz 

on  the  units  of  your  data  channels.  Users  can  use  the  optional  conversion  from 
encounter  to  wave  frequency,  which  is  based  on  the  current  condition’s  speed 
and  heading,  to  convert  RAOs  from  encounter  (observed)  frequency  to  wave  fre¬ 
quency. 


6.2  Encounter  to  Wave  Frequency  Conversion 

Encounter  frequency  spectra  show  frequencies  as  they  were  observed  or  encoun¬ 
tered  on  the  ship.  Converting  to  wave  frequency  adjusts  spectra  frequencies  to 
give  the  same  spectra  frequencies  as  a  stationary  wave  buoy,  which  essentially 
removes  speed  and  heading  effects  of  the  ship  movement. 

The  optional  conversion  from  encounter  to  wave  frequency[17,  18]  is  com- 

-l  +  Jl+4(i^i)U,e 

puted  using  wwave  = - ^/vcoiten - ,  where  g  =  32.18  ft/sec/sec,  V'  =  speed 

\  9  ) 

in  ft/sec,  6076 ft  =  1  Nautical  Mile,  0  =heading  in  degrees,  HeadSeas  =  0 
degrees,  voe  =  fe2ir,  and  fw  =  Head  seas  means  that  the  ship  is  heading 
straight  into  the  waves.  This  equation  works  for  all  runs  with  headings  from  0  to 
<  90  degrees  and  from  >  270  degrees  to  360  degrees.  If  the  heading  is  beam  seas, 
90  or  270  degrees,  the  wave  frequency  is  equal  to  the  encounter  frequency.  The 
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,,  RV  Triton  Wei bull  Sea  State  5  16  Knots  Head  Seas 

we i bull  y 


Figure  7:  RV  Triton  Range  Amplitudes  Weibull 


conversion  in  following  and  stern  quartering  seas,  >  90  degrees  to  <  270  degrees, 
is  not  implemented  because  the  solution  can  be  discontinuous  and  indeterminate. 


7  What  Does  “hvdas  -weibull”  Do? 

“hvdas  -weibull”  computes  Weibull [6]  distribution  statistics  on  a  set  of  data  am¬ 
plitudes  and  is  designed  to  reduce  raw  test  data  into  a  manageable  spreadsheet 
of  linearized  Weibull  distribution  parameters.  These  statistics  are  calculated  for 
either  raw,  low-pass,  or  high-pass  filter  states  on  selected  channels,  files,  and  con¬ 
ditions.  The  results  are  computed  on  the  entire  set  of  amplitudes  that  exist  in  a 
single  test  condition,  which  yields  one  output  file  per  condition  for  each  variant 
of  analysis.  Weibull  analysis  linearizes  the  data  amplitudes[6],  in  Weibull  space, 
and  computes  trend  lines  for  lifetime  estimation[6]. 

Figure  7  shows  linearized  Weibull  amplitudes  and  two  corresponding  solution 
methods:  2  parameter  linear  regression  and  2  parameter  moment  method. 


24 


NSWCCD-65-TR-2003/02 


7.1  Solution  Methods 

7.1.1  Weibull  Linearizing 

The  selected  data  amplitudes  can  be  linearized  into  a  y  =  m  *x+b  format[6].  The 
Weibull  Y-axis  data  can  be  represented  by  In  (in  ))  =  P  In  (x)  —  pin  (77), 

where  P  (x)  =  1  —  .  A  linearized  Weibull  plot  can  be  achieved  by  plotting 

the  Weibull  Y-axis  data  against  In  (x)  on  the  X-axis.  If  data  amplitudes  are  Weibull 
in  nature,  this  will  yield  a  straight  line  in  slope-intercept  form  where  P  is  the  slope 
and  (—ft  In  (77))  is  the  Y-intercept. 

7.1.2  2-Parameter  Linear  Regression  Method 

1 .  Find  data  amplitudes, 

2.  Rank  amplitudes  in  ascending  order, 

3.  Linearize  the  ordered  amplitudes  in  Weibull  space, 

4.  Perform  a  linear  regression,  and 

5.  Determine  the  correlation  coefficient. 


7.1.3  Moment  Method  Iterative  Calculation 


The  moment  method[6]  attempts  to  determine  the  line  that  best  represents  the 
Weibull  data  based  completely  on  the  mean  and  variance  of  the  amplitudes.  The 

shape,  or  slope,  of  the  Weibull  distribution  can  be  completely  defined  by  the  mean 

2  rf  i-f-— ) 

and  variance  of  the  amplitudes;  as  shown  here  %  =  7— f —  1.  Iterating 

through  this  equation  will  yield  /3,the  moment  method  shape  parameter,  which 
can  be  used  along  with  the  characteristic  value  from  the  population  to  determine  a 
moment  method  line,  which  should  better  represent  the  higher  magnitude  Weibull 
amplitudes.  The  characteristic  value  can  be  determined  by  //T  =  77  (r  ( 1  +  iJJ. 
Provided  that  the  data  are  known  to  be  Weibull,  the  moment  method  is  a  bias-free 
method  of  estimating  the  Weibull  parameters. 


7.1.4  2-Parameter  Moment  Method 

1 .  Find  data  amplitudes, 
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2.  Calculate  the  mean  of  the  amplitudes  (fix), 

3.  Calculate  the  variance  of  the  amplitudes  ( a £), 

4.  Iteratively  solve  for  beta,  the  shape  parameter,  and 

5.  Calculate  the  moment  method  line 


7.1.5  3-Parameter  Moment  Method  Iterative  Calculation 


The  moment  method[6]  attempts  to  determine  the  line  that  best  represents  the 
Weibull  data  based  completely  on  the  mean  and  variance  of  the  amplitudes.  The 

_,£-£asg 

general  three-parameter  Weibull  distribution  is  P  =  1  —  e  T>-*o'  ,  where  p  is  the 
Weibull  slope  or  shape  parameter,  Xo  is  the  threshold  value  of  the  data,  77  is  the 
characteristic  value  of  the  distribution  of  data,  P  is  the  cumulative  probability,  and 
x  is  the  Weibull  distributed  data. 

The  mean  and  variance  of  Weibull  data  can  be  expressed  as:  /zx  =  (t]x  - 
z0)r(l  +  j)  +  xq  and  o\  -  (rjx  -  x0 )2  [r(l  +  |)  -  (T(l  +  ^))2].  The  charac¬ 
teristic  value  can  be  estimated  by  choosing  the  value  in  the  distribution  with  a 
cumulative  probability  as  close  as  possible  to  0.632.  A  bounding  range  for  beta 
can  be  found  using  the  following  equation:  =  T(1  +  ^).  The  threshold 

can  range  from  0  to  the  smallest  actual  data  amplitude,  which  can  be  used  in  the 
previous  equation  to  bound  beta. 

The  Weibull  slope  can  be  solved  for  iteratively  by  balancing  the  left  and  right 
sides  of  the  following  equation  to  the  desired  level  of  accuracy. 


Vx-- 


7?:r  r(l  +  ^  )  —  fj. 


r(i+A)-i 


r(i+— )— fr(i+— )]2 

- ^  'eaves  onlY  xo  to  be  solved  for  in  the  following  equation: 

<7xT(i+l) 

X0  =  p,x  -  - - 2 - -T-. 

{r(i+f)-[r(i+i)]-}- 


7.1.6  3-Parameter  Moment  Method 

1 .  Find  data  amplitudes, 

2.  Calculate  the  mean  of  the  amplitudes  (//x), 

3.  Calculate  the  variance  of  the  amplitudes  (a'x). 
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4.  Estimate  the  characteristic  value  (?/,.), 

5.  Find  bounds  for  beta, 

6.  Iteratively  solve  for  beta, 

7.  Solve  for  the  Weibull  threshold  (x0),  and 

8.  Calculate  the  moment  method  line 

7.2  Amplitude  Selection 

7.2.1  Maximum  Amplitudes 

This  method  of  amplitude  selection  uses  peaks  that  occur  above  the  mean  of  the 
time  history  in  the  Weibull  calculation. 

7.2.2  Minimum  Amplitudes 

This  method  of  amplitude  selection  uses  troughs  that  occur  below  the  mean  of  the 
time  history  in  the  Weibull  calculation. 

7.2.3  Maximum  •  Mean  Amplitudes 

This  method  of  amplitude  selection  uses  all  peaks  -  mean  of  the  time  history  in  the 
Weibull  calculation.  These  amplitudes  are  determined  by  subtracting  the  mean  of 
the  time  history  from  the  maximum  amplitudes. 

7.2.4  Minimum  -  Mean  Amplitudes 

This  method  of  amplitude  selection  uses  all  troughs  -  mean  of  the  time  history  in 
the  Weibull  calculation.  These  amplitudes  are  determined  by  subtracting  the  mean 
of  the  time  history  from  the  minimum  amplitudes. 

7.2.5  Peak-to-Peak  Range  Amplitudes 

This  method  of  amplitude  selection  uses  all  local  half-cycle  peak-to-peak  ranges 
(maximums  -  minimums)  about  the  mean  of  the  time  history  in  the  Weibull  cal¬ 
culation.  These  amplitudes  are  determined  by  looking  for  oscillations  about  the 
mean  value  of  the  time  history.  The  peak-to-peak  amplitudes  have  double  the 
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number  of  amplitudes  as  maximums  or  minimums  because  every  half-cycle  am¬ 
plitude  is  counted,  which  means  all  peak-to-trough  amplitudes  and  trough-to-peak 
amplitudes.  This  ensures  that  the  Weibull  distribution  data  contains  the  largest 
half-cycle  event  in  the  time  history.  One  must  be  careful  when  using  these  am¬ 
plitudes  however.  The  number  of  peak-to-peak  amplitudes  is  twice  the  number  of 
wave  encounters. 

7.2.6  Raw  Amplitudes 

This  method  of  amplitude  selection  treats  the  entire  input  data  channel  as  a  set  of 
amplitudes.  This  means  that  you  can  use  another  program  to  generate  or  adjust 
the  amplitudes  and  then  analyze  them  in  HVDAS.  This  allows  another  program, 
such  as  IGOR  or  Excel,  to  perform  the  amplitude  selection.  These  amplitudes  can 
then  be  run  through  HVDAS  to  have  Weibull  analysis  performed  on  them. 

7.2.7  Whipping  Amplitudes 

This  method  of  amplitude  selection  looks  for  football  shaped  series  of  consecutive 
high  pass  filtered  amplitudes. 

7.2.8  Impact  Amplitudes 

This  method  of  amplitude  selection  looks  for  a  certain  duration  event  that  is 
greater  than  a  threshold  value. 

7.3  Filter  Choices 

This  software  has  the  ability  to  separate,  for  further  Weibull  analysis,  frequency 
components  of  a  time  domain  signal. 

7.3.1  Low  Pass 

The  low-pass  Finite  Impulse  Response  (FIR)  filter  is  usually  used  to  remove  high- 
frequency  energy  from  the  time  domain  signal.  Use  it  to  yield  the  quasi-static 
ordinary  wave-induced  portion  of  the  signal  by  removing  higher  frequency  vi¬ 
bration,  slamming,  and  whipping  cycles.  The  amplitude  selection  steps  are  as 
follows. 

1 .  Read  in  the  raw  data. 
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2.  Low-pass  FIR  filter  the  raw  data. 

3.  Find  all  mean  crossings  and  relative  maximums  and  minimums  in  the  fil¬ 
tered  time  history. 

4.  Use  the  local  maximums  and  minimums  to  generate  local  ranges,  also  called 
peak-to-peak  values. 

5.  Select  the  proper  amplitude  set  and  perform  the  Weibull  analysis. 

7.3.2  High  Pass 

The  high-pass  FIR  filter  will  remove  low-frequency  energy  from  the  signal.  Use  it 
to  yield  the  vibration,  slamming,  and  whipping  portion  of  the  signal  by  removing 
low  frequency  ordinary  wave-induced  energy.  The  amplitude  selection  steps  are 
as  follows. 

1 .  Read  in  the  raw  data. 

2.  Low-pass  FIR  filter  the  raw  data. 

3.  Find  all  mean  crossings  in  the  low-pass  FIR  data  to  identify  wave  events 
experienced  by  the  ship. 

4.  High-pass  FIR  filter  the  raw  data. 

5.  Find  relative  maximums  and  minimums  in  the  high-pass  filtered  time  his¬ 
tory  using  the  mean  crossing  locations. 

6.  Use  the  local  maximums  and  minimums  to  generate  local  ranges,  also  called 
peak-to-peak  values. 

7.  Select  the  proper  amplitude  set  and  perform  the  Weibull  analysis. 

7.3.3  Raw 

Raw  is  the  absence  of  a  filter  and  will  not  remove  any  energy  from  the  signal.  We 
usually  use  it  to  yield  the  wave+whipping  portion  of  the  signal.  The  amplitude 
selection  steps  are  as  follows. 

1 .  Read  in  the  raw  data. 
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2.  Low-pass  FIR  filter  the  raw  data  to  identify  wave  encounters. 

3.  Find  all  mean  crossings  in  the  low-pass  FIR  data  to  identify  wave  events 
experienced  by  the  ship. 

4.  Find  relative  maximums  and  minimums  in  the  raw  time  history  using  the 
mean  crossing  locations. 

5.  Use  the  local  maximums  and  minimums  to  generate  local  ranges,  also  called 
peak-to-peak  values. 

6.  Select  the  proper  amplitude  set  and  perform  the  Weibull  analysis. 

7.3.4  Already  Filtered 

The  already  filtered  option  will  a  simple  result  in  the  Weibull  calculation.  The 
data  is  assumed  to  be  already  filtered.  This  removes  the  digital  FIR  filtering  step 
from  the  amplitude  selection  process. 

1 .  Read  in  the  raw  already  filtered  data. 

2.  Find  all  mean  crossings  and  relative  maximums  and  minimums  in  the  al¬ 
ready  filtered  time  history. 

3.  Use  the  local  maximums  and  minimums  to  generate  local  ranges,  also  called 
peak-to-peak  values. 

4.  Select  the  proper  amplitude  set  and  perform  the  Weibull  analysis. 

7.4  Prediction 

The  main  goal  of  Weibull  analysis  is  to  statistically  characterize  the  data  and  to 
make  predictions.  Finite  amounts  of  test  data,  that  are  Weibull  in  nature,  can  be 
analyzed  with  this  software  and  yield  response  predictions  based  on  estimates  of 
many  years  or  even  a  ship’s  entire  lifetime. 

There  are  two  main  types  of  predictions  that  we  use  Weibull  analysis  for:  fa¬ 
tigue  life  and  lifetime  maximum  value.  For  fatigue  life  prediction,  a  two  or  three 
parameter  linear  regression  is  usually  sufficient,  because  it  is  the  line  that  best 
matches  the  majority  of  amplitudes  that  occurred  during  the  test.  The  two  or  three 
parameter  Moment  Method  line  usually  does  a  better  job  of  estimating  maximum 
lifetime  values. 
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For  ship  structures  and  wave  data,  wave  induced  behavior  usually  has  a  linear 
regression  Weibull  slope  of  around  2,  corresponding  to  a  Rayleigh  distribution. 
Slamming  and  vibration  behavior  usually  has  a  linear  regression  Weibull  slope 
of  around  1 .  Normal  distribution  Gaussian  behavior,  when  treated  as  a  Weibull 
distribution,  usually  has  a  linear  regression  Weibull  slope  of  around  3.5. 

7.4.1  Parent  Weibull  Distribution  Definition 

The  Parent  Weibull  Distribution  Definition  is  P  (. x )  =  1  —  )  .  For  real  data,  P 

is  estimated  by  yyy,  where  n  is  the  actual  number  of  real  data  amplitudes  from  the 
trial  or  model  test.  For  estimated  lifetime  data,  P  is  estimated  by  -^yy,  where  N  is 
the  estimated  number  of  data  points  that  would  be  generated  in  a  lifetime  exposure 
to  a  given  single  condition.  P  is  the  most  probable  value  at  N  for  an  entire  lifetime 

of  exposure.  The  expected  lifetime  value  x  =  ??  [— In  (l  —  T^fy)]  ^ ■ 

7.4.2  Extreme  Value  Distribution  of  the  Ship  Lifetime  Max 

The  Extreme  Value  Distribution  of  the  ship  lifetime  max  for  the  Nth  point  is 

F  (TV)  =  1-e  W  .  For  multiple  ship  lifetimes,  like  a  class  of  ships,  P(N) 

would  have  a  distribution  of  its  own.  To  find  the  extreme  value  of  P  that  is  ex¬ 
ceeded  in  only  1  of  10  lifetimes,  we  would  set  F  ( N )  =  0.9  and  solve  for  x.  The 

extreme  value  x  =  7]  -ln(l-F^y. 

7.5  Weibull  Example  Problem 

Assume  that  we  have  determined  the  shape  parameter  f3= 2  and  the  characteristic 
value  ?7=10  from  a  moment  method  or  linear  regression  Weibull  analysis  of  some 
time  history  data.  Now  assume  that  a  lifetime  exposure  to  the  condition  being 
analyzed  would  produce  a  population  of  500  points.  To  find  the  estimate  of  the 
“most  probable  extreme  value”  of  this  500th  point,  solve  for  x  in  the  following 

equation.  In  (in  (yzW))  =  2 ln(x)  -  2/n(10),  1.8272  =  2 ln(x)  -  4.6052, 
which  yields  x  =  24.93.  To  find  the  value  in  the  distribution  associated  with  the 

500th  point  that  is  exceeded  only  1  in  10  times;  0.9s5°  =  1  —  = 

0.000211,  which  yields  x  =  29.095.  However,  if  you  plug  24.93  into  the  extreme 
value  equation  and  solve  for  F  ( N ),  you  will  find  that  the  most  probable  value  of 
24.93  has  a  63.23%  chance  of  being  exceeded.  It  is  likely  that  the  designer  will 


31 


NSWCCD-65-TR-2003/02 


Figure  8:  Virtual  Channel  Block  Diagram 

want  a  much  smaller  chance  of  the  predicted  extreme  value  being  exceeded.  For 
example,  typical  values  selected  for  F  ( N )  might  be  0.9, 0.95, 0.99,  or  0.999.  The 
choice  of  this  value  should  be  representative  of  the  size  of  the  population  and  the 
consequence  of  exceeding  the  maximum  value. 

8  What  Does  “hvdas  -convertdata”  Do? 

“hvdas  -convertdata”  can  use  the  MMM  configuration  settings  to  modify  and  con¬ 
vert  the  original  input  data.  Data  conversion  can  be  used  to  filter,  smooth,  scale, 
subtract  initial  condition  zero  values,  or  compute  virtual  channels  from  the  origi¬ 
nal  input  data.  Additionally,  this  operation  can  be  performed  on  binary  or  ASCII 
input  data.  The  output  will  be  in  ASCII  tab-delimited  text  format. 

8.1  Virtual  Channels 

Figure  8  shows  a  block  diagram  describing  the  procedure  used  to  create  virtual 
channels. 
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Figure  9:  Crossover  Region  Filter  Design  Work 

9  FIR  Filter  Design 

HVDAS  does  not  have  any  built-in  limitations  when  it  comes  to  Finite  Impulse 
Response  (FIR)  filters.  HVDAS  imports  its  filters  as  lists  of  filter  coefficients, 
which  need  to  be  generated  by  some  other  program,  such  as  Wave  Metrics  IGOR 
Pro  IFDL.  A  higher  number  of  filter  coefficients  is  not  necessarily  better.  Filters 
with  high  numbers  of  coefficients  generally  have  a  larger  impulse  response,  which 
means  that  the  output  exhibits  a  “ringing”  filtering  impulse-like  events  and  conse¬ 
quentially  produce  an  impulse  response,  which  could  be  larger  than  the  data  being 
analyzed.  The  number  of  filter  coefficients  also  places  requirements  on  the  size 
of  data  file  that  HVDAS  can  filter.  HVDAS  requires  data  files  to  have  more  scans 
than  the  number  of  filter  coefficients.  It  is  mathematically  impossible  to  apply  a 
1500  coefficient  FIR  filter  to  a  data  file  that  contains  only  500  or  1000  samples. 

For  most  ship  structures,  there  is  a  significant  difference  between  the  directly 
wave-induced  frequency  response  and  the  first-mode  vibratory  frequency  response. 
This  frequency  gap  can  be  advantageous  when  designing  FIR  filters.  The  example, 
shown  in  Figure  9,  came  from  RV  Triton,  which  is  a  full  scale  trimaran  demon¬ 
strator  ship.  The  channel  chosen  is  VSTR1 16,  which  is  the  midship  keel  gage 
measuring  axial  strain  due  to  vertical  longitudinal  bending.  Figure  9  shows  PSDs 
of  raw,  low-pass  FIR  filtered,  and  high-pass  FIR  filtered  data  in  Wave  Metrics 
IGOR  Pro.  The  crossover  frequency  of  1 .55  Hz  was  chosen  because  it  is  about 
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Figure  10:  Crossover  Region  Close  Up 

half  way  between  the  wave-induced  energy  and  the  first  mode  vibratory  response. 
The  crossover  frequency  needs  some  frequency  space  on  either  side  of  it  because 
FIR  filters  are  not  perfect  and  do  not  have  immediate  or  infinite  attenuation.  Fig¬ 
ure  1 0  shows  a  close  up  of  the  crossover  region.  Figure  1 1  shows  the  raw,  low-pass 
FIR  filtered,  and  high-pass  FIR  filtered  time  histories. 

Hie  crossover  region  can  be  a  single  frequency  step  or  a  wide  range  of  frequen¬ 
cies.  Different  data  may  not  even  need  the  filters  to  cross  over  in  the  frequency 
domain. 


10  Requirements  and  Limitations 

•  All  channel  numbers  used  by  this  software  are  numbered  starting  from  zero 
for  referencing  puiposes.  The  first  data  channel  will  be  referred  to  as  chan¬ 
nel  ’0’  and  the  last  data  channel  will  be  the  number  of  total  channels  minus 
one.  For  example:  if  your  data  files  have  54  total  channels,  you  will  need  to 
refer  to  each  individual  channel  as  0  through  53. 

•  Each  block  of  data  (the  folders/files  to  be  run  with  the  same  configuration 
files)  must  have  the  same  channel  numbering  scheme  throughout.  For  ex¬ 
ample,  if  you  have  chosen  to  analyze  channel  ’3’,  then  channel  ’3’  must 
refer  to  the  same  channel  throughout  the  data  block  for  consistent  results. 
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Figure  1 1 :  Raw,  Low-Pass  FIR,  and  High-Pass  FIR  Time  Histories 

•  The  only  data  types  verified  are  binary,  4-byte,  single-precision,  high-byte- 
first  interleaved  data;  2-byte,  unsigned-integer,  low-byte-first  interleaved 
data;  and  ASCII,  tab-delimited,  text  data.  4-byte,  single-precision,  low- 
byte-first  data  files  are  also  supported,  but  not  heavily  tested.  Future  ver¬ 
sions  will  better  accommodate  multiple  file  formats. 

•  Data  files  in  a  single  condition  directory  must  have  the  same  data  format, 
number  of  channels,  naming  scheme  and  scale  factors. 

•  This  software  assumes  that  your  data  files  follow  the  numeric  naming  con¬ 
ventions:  FILE-PREFIX-###-FILE-EXTENSION  or  FILE-PREFIX-#-FILE- 
EXTENSION. 

•  It  is  a  good  idea  to  stay  away  from  spaces  in  file  names.  Not  all  systems 
handle  spaces  in  file  names  the  same  way,  which  makes  it  difficult  to  code 
for  compatibility  across  all  systems.  If  you  need  to  use  a  space  in  a  file 
name  or  condition  label,  replace  it  with  an  underscore 

•  This  software  assumes  that  input  data  files  have  at  least  4-character  file 
names. 

•  You  must  have  LAM  MPI  installed  to  compile  the  source  code. 

•  You  must  have  VSIPL  core  or  core  plus  to  compile  the  source  code. 
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Program/Library 

Lines  of  Code 

Executable/Compiled  Size  (Bytes) 

hvdalibrary 

18546 

5447464 

hvdas 

13657 

7398535 

Table  1 :  Code  and  Executable  Size  Breakdown 

•  This  software  will  not  do  everything  for  you.  You  must  spend  time  getting 
familiar  with  your  data  and  its  layout.  You  will  be  required  to  make  intelli¬ 
gent  decisions  about  analysis  options  which  can  affect  your  results.  A  good 
way  to  do  this  is  by  using  Wave  Metrics  IGOR  Pro  to  look  at  and  analyze 
small  amounts  of  data.  Once  you  know  what  you  are  doing,  run  a  small 
batch  of  analysis,  check  the  results  to  make  sure  you  are  getting  what  you 
want,  and  then  run  the  entire  batch  of  automated  analysis. 

•  Time  selection  support  has  been  tested  with  1  or  more  files.  Time  selection 
start  and  end  times  must  be  input  correctly.  Times  that  exceed  the  end  of 
your  data  files  may  not  be  properly  detected  and  may  cause  the  program  to 
segfault. 

•  HVDAS  will  currently  only  scale  up  to  the  number  of  channels  in  your  data 
files.  If  you  try  to  analyze  a  set  of  data  files  that  contain  100  channels  each 
on  a  cluster  with  128  processors,  HVDAS  will  only  use  101  processors;  100 
client  processors  and  1  server  processor. 

11  Software  Organization 

11.1  General  Software  Overview 

HVDAS  is  about  32,203  lines  of  original  C++  code,  including  whitespace  and 
comments,  as  of  HVDAS  version  2003-1 1-09.  Printing  HVDAS  would  require 
about  620  printed  pages,  assuming  an  average  of  52  text  lines  per  printed  page 
on  ISO  A4  paper.  This  line  count  does  not  include  any  of  the  linked  code  in 
VSIPL  or  LAM-MPI,  which  were  developed  by  other  people.  Figure  1 2  shows  the 
relationship  between  the  operating  system,  GNU  GCC  compilers,  and  HVDAS. 
Table  1  shows  the  breakdown  of  code  and  executable  size  among  the  different 
components  of  HVDAS. 
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Figure  12:  HVDAS  General  Software  Overview 

11.2  How  Does  HVDAS  Analyze  Data  Files  So  Fast? 

HVDAS  uses  a  coarse  parallelization  to  achieve  its  speed.  At  NSWCCD,  Code  65, 
there  are  typically  a  large  number  of  files  and  data  channels  to  calculate  statistics 
from.  In  the  early  design  phases  of  HVDAS  it  was  determined  that  speeding  up 
bulk  data  analysis  was  more  important  than  speeding  up  the  analysis  of  a  single 
channel.  This  led  to  the  use  of  a  single  data  channel,  or  time  history,  as  the  smallest 
piece  of  data  to  analyze.  Breaking  up  the  work  by  channel  is  a  logical  and  highly 
parallel  analysis  method,  but  it  does  not  help  analyze  a  single  data  channel  any 
faster  than  our  uniprocessor  analysis  code. 

Figure  13  shows  the  work  flow  distribution  that  allows  HVDAS  to  perform 
and  scale  so  well. 

11.3  How  Do  The  HVDAS  Programs  Analyze  Data  Files  In 
Parallel? 

11.3.1  Server  Algorithm  Overview 

Figure  14  shows  how  the  server  portion  of  HVDAS  loops,  breaks  up  the  calcu¬ 
lations,  distributes  work  to  the  client  nodes,  and  receives  results  from  the  client 
nodes. 
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Figure  14:  HVDAS  Server  Algorithm  Overview 
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11.3.2  Client  Algorithm  Overview 

Figure  15  shows  how  the  client  portion  of  HVDAS  loops,  receives  work  requests 
from  the  server  node,  performs  calculations,  and  sends  results  back  to  the  server 
node. 

11.4  Data  Distribution 

HVDAS  does  not  explicitly  send  any  actual  data  channels  to  the  client  nodes  using 
the  Message  Passing  Interface  (MPI).  HVDAS  sends  only  the  information  that  the 
clients  need  to  open  up  the  data  files  themselves.  HVDAS  is  organized  this  way 
to  minimize  the  amount  of  bandwidth  used  up  by  server  to  client  communication. 
This  distributed  data  importing  allows  the  data  to  be  hosted  in  a  wide  variety  of 
places. 

The  data  can  be  easily  placed  on  a  RAID-5  archive  machine  and  shared  with 
the  client  nodes  via  Microsoft  Windows  Network  File  Sharing  (SAMBA)  or  UNIX 
Network  File  System  (NFS),  but  that  is  just  one  possibility.  The  HVDAS  method 
of  data  import  allows  the  data  to  be  hosted  on  any  cluster-accessible  file  system. 
Data  can  even  be  hosted  on  each  client  node;  as  long  as  every  other  client  node 
has  network  access  to  it. 

One  of  the  most  beneficial  results  of  this  design  is  the  ability  to  use  distributed, 
or  parallel,  file  systems.  This  allows  the  cluster  nodes,  or  additional  data  nodes, 
to  stripe  and  store  data,  which  will  maximize  storage  space,  minimize  network 
bottlenecking,  and  maximize  input  output  speed. 

HVDAS  works  successfully  with  Microsoft  Windows  Network  File  Sharing 
(SAMBA),  UNIX  Network  File  System  (NFS),  Parallel  Virtual  File  System  (PVFS), 
and  all  combinations  of  the  three. 

1 1 .5  Bandwidth  Utilization 

Minimized  network  communication  maximizes  performance  and  expandability. 
Network  saturation  can  kill  the  performance  benefits  of  using  Linux  clusters.  HV¬ 
DAS  relies  heavily  on  Linux’s  and  UNIX’s  ability  to  cache  almost  everything 
without  any  effort  from  an  application.  When  a  client  node  reads  in  a  single  chan¬ 
nel  from  a  data  file,  the  operating  system,  Linux,  will  try  to  cache  the  entire  data 
file  in  memory  regardless  of  the  source  of  the  data  file.  This  means  that  data 
files  that  get  read  in  from  networked  file  systems  will  get  cached  in  memory  by 
the  client  node’s  operating  system.  If  that  client’s  next  work  request  is  a  different 
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Figure  15:  HVDAS  Client  Algorithm  Overview 
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channel  in  the  same  data  file,  which  will  happen  quite  often  if  the  number  of  nodes 
in  the  cluster  is  less  than  the  number  of  channels  in  the  data  file,  the  operating  sys¬ 
tem  will  read  the  data  from  cache  instead  of  reading  it  again  over  the  network. 
This  behavior  does  not  require  any  special  programming,  which  is  another  reason 
to  not  send  the  data  channels  using  MPI. 

11.6  Storage  Minimization 

All  of  HVDAS’  results  are  stored  as  ASCII  tab-delimited  text.  Ensuring  that  all  of 
the  results  files,  with  a  significant  amount  of  data  in  them,  are  not  padded  with  any 
kind  of  white  space  or  extra  characters  reduces  file  size.  HVDAS  can  optionally 
skip  individual  file  statistics  output  or  condition  summary  output  to  further  cut 
down  on  results  storage  space. 

11.7  Scalability 

HVDAS  can  scale  from  one  to  thousands  of  nodes.  It  is  possible  to  run  one  server 
and  one  client  portion  of  HVDAS  on  a  single  processor.  It  is  possible  to  run  one 
server  and  two  client  portions  of  HVDAS  on  a  dual  processor  computer  to  use 
both  processors  at  the  same  time.  It  is  also  possible  to  run  HVDAS  on  a  cluster  of 
single  and/or  Symmetric  Multi-Processing  (SMP)  nodes  and  use  every  processor 
in  the  cluster.  HVDAS  will  currently  only  scale  up  to  the  number  of  channels  in 
your  data  files.  If  you  try  to  analyze  a  set  of  data  files,  that  contain  100  channels 
each,  on  a  cluster  with  128  processors,  HVDAS  will  only  use  101  processors;  100 
client  processors  and  1  server  processor. 

11.8  Performance  Maximization 

HVDAS  is  quite  fast  even  on  a  single  processor  computer.  Huge  linear  perfor¬ 
mance  increases  come  as  a  result  of  adding  nodes  and  processors.  Network  speed, 
processor  speed,  memory  speed,  system  bus  speed,  and  input  output  storage  sub¬ 
system  speed  also  greatly  impact  performance.  The  key  to  maximizing  the  parallel 
calculation  performance  increase  is  to  make  sure  that  the  nodes  spend  more  time 
calculating  than  they  do  communicating  or  waiting. 
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Figure  16:  HVDAS  Parallel  Benefits 

11.9  Parallel  Benefits 

Figure  1 6  shows  the  benefits  of  using  HVDAS  on  a  Linux  cluster.  It  is  evident  that 
the  compute  time  roughly  halves  when  the  number  of  nodes  doubles.  The  parallel 
calculation  time  is  nearly  CalcTimen  =  CalcTime  where  n  is  the  number  of 
processors.  This  behavior  will  continue  until  the  communication  network  or  some 
other  part  of  the  Linux  cluster  becomes  saturated.  This  performance  increase  be¬ 
havior  makes  analysis  time  prediction  very  easy.  Using  this  behavior,  it  is  possible 
to  predict  the  analysis  time  for  different  data  sets  or  additional  processors. 

12  Data  Formats 

This  software  supports  four  data  formats:  ASCII  columns,  4-byte  binary  inter¬ 
leaved  with  high-byte-first  byte  ordering,  4-byte  binary  interleaved  with  low-byte- 
first  byte  ordering,  and  2-byte  unsigned  integer  interleaved  with  low-byte-first 
byte  ordering.  The  data  format  is  a  required  input  for  the  program  to  function 
properly.  If  the  data  are  in  any  other  format,  they  must  be  converted  to  one  of  the 
acceptable  formats  prior  to  being  run. 

Using  the  wrong  format  may  not  cause  a  fatal  error  but  would  cause  the  output 
to  be  completely  meaningless.  The  headers  in  all  data  files  are  ignored. 

If  you  have  a  header  that  exists  in  your  data  on  a  per  scan  basis,  you  should  try 
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to  read  the  scan  header  in  as  one  or  more  dummy  channels  instead  of  converting 
data  formats  or  writing  another  input  plug-in. 

12.1  ASCII  Columns 

In  the  analysis  software,  the  headers  of  the  ASCII  files  are  skipped.  The  data  are 
assumed  to  be  in  vertical,  tab-delimited  columns. 

12.2  Binary  Interleaved  High  Byte  First 

•  IEEE  32-bit  (4-byte)  single  precision  floating  point  numbers, 

•  Big  endian  (high-byte-first)  byte  ordering, 

•  Stored  using  interleaved  data  points. 

12.3  Binary  Interleaved  Low  Byte  First 

•  IEEE  32-bit  (4-byte)  single  precision  floating  point  numbers, 

•  Little  endian  (low-byte-first)  byte  ordering, 

•  Stored  using  interleaved  data  points. 

12.4  Binary  Interleaved  Unsigned  Short 

•  IEEE  1 6-bit  (2-byte)  unsigned  integers, 

•  Little  endian  (low-byte-first)  byte  ordering, 

•  Stored  using  interleaved  data  points. 

•  This  data  type  is  particularly  useful  when  reading  in  data  stored  as  integer 
scans  or  integer  counts. 
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13  Input 

Input  to  the  HVDAS  programs  can  be  highly  varied,  but  there  are  a  few  guidelines 
to  follow.  Keep  it  as  simple  as  possible.  Analyze  similar  data  at  the  same  time. 
Keep  these  things  in  mind  when  collecting  data  that  you  plan  on  analyzing  with 
HVDAS. 

13.1  When  HVDAS  is  Simple  to  Set  Up 

Analyze  the  data  from  a  trial,  which  are  made  up  of  multiple  test  conditions,  as  one 
data  set.  The  simplest  input  directory  structure  is  organized  as  /TrialO/ConditionO- 
N/RunO-N,  where  Runs  0-N  are  numbered  sequentially  and  follow  the  convention 
File  Prefix<0-N>File  Extension.  This  is  the  easiest  possible  input  structure  to 
analyze  because  HVDAS  was  built  around  this  input  structure.  Everything  will  be 
easy  to  set  up  if  the  number  of  channels,  the  channel  order,  the  scale  factors,  the 
sample  rate,  and  the  data  file  format  remained  constant. 

13.2  When  HVDAS  is  Complicated  to  Set  Up 

If  the  input  data  set  is  not  set  up  in  the  ideal  structure,  all  is  not  lost,  but  you  should 
be  more  familiar  with  running  the  code  to  avoid  running  into  problems.  Simple 
UNIX  scripts  can  be  written  to  rename  files  and  folders  in  bulk,  which  will  make 
the  user’s  job  less  painful.  If  the  data  exist  in  multiple  file  formats  or  sample  rates, 
you  should  consider  running  the  analysis  in  two  phases  or  converting  all  of  the 
data  to  a  common  file  format.  Configuration  will  be  more  difficult  to  set  up  if  the 
number  of  channels,  channel  order,  scale  factors,  sample,  or  data  file  format  vary. 

13.3  Example  Input  Structure 

This  is  just  one  possible  file  path  structure.  This  example  assumes  that  each  condi¬ 
tion  folder  contains  binary  data  files  named  datarun_0.binary  through  datarun_3.binary, 
but  each  condition  does  not  have  to  be  identical.  Example  output  and  configura¬ 
tion  files  are  detailed  in  their  respective  sections. 

/server/test/condition  1  / 

/server/test/condition2/ 

/server/test/condition3/ 

/server/test/HVDAGlobalConfiguration.conf 

/server/test/HVDAMMMConfiguration.conf 
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/server/test/HVDAPSDConfiguration.conf 

/server/test/HVDARAOConfiguration.conf 

/server/test/HVDAWeibullConfiguration.conf 


14  Output 

Output  from  every  program  in  HVDAS  is  visible  from  Excel,  Star  Office,  Open 
Office,  Word  Pad,  gedit,  and  gnuplot.  The  results  are  saved  as  generic  ASCII, 
tab-delimited,  text  files.  All  header  information  in  HVDAS  output  files  have  a 
preceding  “#”,  which  makes  them  compatible  with  gnuplot. 

Output  is  stored  in  a  directory  structure  similar  to  the  input  data  structure.  The 
base  results  folder,  named  by  the  user  in  a  ’HVDA*Configuration.conf  file,  will 
contain  all  of  the  output.  For  basic  MMM  analysis,  the  results  will  be  in  the  sub¬ 
folder  named  ’HVDAMMMResults’.  Modified  and  converted  input  data  will  be 
stored  in  the  sub-folder  named  ’HVDAConvertedOutputData’.  For  PSD  analysis, 
the  results  will  be  in  the  sub-folder  named  ’HVDAPSDResults’.  For  RAO  analy¬ 
sis,  the  results  will  be  in  the  sub-folder  named  ’HVDARAOResults’.  For  Weibull 
analysis,  the  results  will  be  in  the  sub-folder  named  ’HVDAWeibullResults’.  At 
the  next  level  the  results  are  broken  down  into  their  respective  conditions  using 
the  condition  labels  defined  in  the  ’HVDAGlobalConfiguration.conf’  file.  These 
folders  contain  the  actual  condition  results,  sorted  by  filter  type,  original  data  file 
name  and  index. 

14.1  MMM  Analysis  Output 

Each  row  in  the  MMM  output  represents  a  channel  of  analyzed  data  and  contains 
the  Channel  Number,  Channel  Name,  Mean,  Max,  Min,  (Maximum  -  Mean), 

(. Minimum  —  Mean),  Range,  Maximum  Peak-To-Peak,  Standard  Deviation,  Kur- 
tosis,  Mean  Crossings,  and  the  ratio  •  0ther  Pertinent  informa¬ 

tion  is  in  the  header  at  the  top  of  the  output  file.  Each  condition,  or  folder,  is 
summarized  on  a  channel-by-channel  basis.  The  summary  gives  values  for  each 
channel  for  each  statistical  value:  Mean,  (Maximum  -  Mean),  etc. 

For  each  condition,  the  program  will  create  one  results  file  for  each  input  file 
for  each  of  four  possible  filter  states.  In  addition,  one  summary  file  is  created 
for  each  filter  state  in  each  condition  and  is  saved  in  the  results  folder  for  that 
condition.  As  with  individual  files,  pertinent  information  is  written  at  the  top  of 
the  summary  file. 
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Output  is  stored  in  a  directory  structure  similar  to  the  input  data  structure.  The 
base  results  folder,  named  by  the  user  in  the  ’HVDAMMMConfiguration.conf’ 
file,  will  contain  all  of  the  output.  For  basic  MMM  analysis  the  results  will  be 
in  the  sub-folder  named  ’HVDAMMMResults’.  Modified  and  converted  input 
data  will  be  stored  in  the  sub-folder  named  ’HVDAConvertedOutputData’.  At 
the  next  level  the  results  are  broken  down  into  their  respective  conditions  using 
the  condition  labels  defined  in  the  ’HVDAGlobalConfiguration.conf  file.  These 
folders  contain  the  actual  condition  results,  sorted  by  filter  type,  original  data  file 
name  and  index. 

14.1.1  Example  Output  Structure 

This  is  just  one  possible  output  structure.  Your  actual  output  structure  will  depend 
on  your  choices  for  base  folder  name,  condition  labels,  desired  filters,  and  the 
number  of  files  analyzed.  The  individual  and  summary  files  are  shown  below. 

/server/test/HVDAMMMResults/conditionl/HVDAMMM_Raw_condition  l_datarun_0.txt 
/server/test/HVDAMMMResults/condition  1  /HVDAMMM_Raw_condition  1  _datarun_  1  .txt 
/server/test/HVDAMMMResults/condition  17HVDAMMM_Raw_conditionl_datarun_2.txt 
/server/test/HVDAMMMResults/conditionl/HVDAMMM_Raw_conditionl_datarun_3.txt 
/server/test/HVDAMMMResults/condition  1  /H  VDAMMM_Raw_condition  1  _Summary.txt 
/server/test/HVDAMMMResults/condition2/HVDAMMM_Raw_condition2_datarun_0.txt 
/server/test/HVDAMMMResults/condition2/HVDAMMM_Raw_condition2_datarun_l.txt 
/server/test/HVDAMMMResults/condition2/HVDAMMM_Raw_condition2_datarun_2.txt 
/server/test/HVDAMMMResults/condition2/HVDAMMM_Raw_condition2_datarun_3.txt 
/server/test/HVDAMMMResults/condition2/HVDAMMM_Raw_condition2_Summary.txt 
/server/test/HVDAMMMResults/condition3/HVDAMMM_Raw_condition3_datarun_0.txt 
/server/test/HVDAMMMResults/condition3/HVDAMMM_Raw_condition3_datarun_l.txt 
/server/test/HVDAMMMResults/condition3/HVDAMMM_Raw_condition3_datarun_2.txt 
/server/test/HVDAMMMResults/condition3/HVDAMMM_Raw_condition3_datarun_3.txt 
/server/test/HVDAMMMResults/condition3/HVDAMMM_Raw_condition3_Summary.txt 

14.1.2  Example  Output  File 

Figure  17  is  an  example  MMM  output  summary  file.  This  graphic  was  printed  to 
a  file  from  Open  Office  Calc. 
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Figure  17:  Example  MMM  Output  File 
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14.2  PSD  Analysis  Output 

The  first  and  left  most  column  contains  the  frequencies  that  correspond  row  by  row 
with  the  PSD  magnitudes.  Each  other  column  represents  a  channel  of  analyzed 
data  and  contains  the  Channel  Name  and  PSD,  which  was  computed  using  the 
PSDFFTMSAM.  Other  pertinent  information  is  in  the  header  at  the  top  of  the 
output  file,  including  the  parameters  used  to  calculate  the  PSD  I-Skip  and  Segment 
Length.  Each  condition,  or  folder,  is  summarized  on  a  channel-by-channel  basis. 

The  summary  gives  values  for  each  frequency’s  PSD  magnitude  for  each  channel. 

For  each  condition,  the  program  will  create  one  results  file  for  each  input  file 
for  either  raw  or  low-pass  filter  states.  In  addition,  one  summary  file  is  created  for 
either  the  raw  or  low-pass  filter  state  in  each  condition  and  is  saved  in  the  results 
folder  for  that  condition.  As  with  individual  files,  pertinent  information  is  written 
at  the  top  of  the  summary  file. 

Output  is  stored  in  a  directory  structure  similar  to  the  input  data  structure.  The 
base  results  folder,  named  by  the  user  in  the  ’HVDAPSDConfiguration.conf’  file, 
will  contain  all  of  the  output.  For  this  basic  analysis,  the  results  will  be  in  the 
sub-folder  named  ’HVDAPSDResults’.  At  the  next  level,  the  results  are  broken 
down  into  their  respective  conditions  using  the  condition  labels  defined  in  the 
’HVDAGlobalConfiguration.conf’  file.  These  folders  contain  the  actual  condition 
results,  sorted  by  filter  type,  original  data  file  name  and  index. 

14.2.1  Example  Output  Structure 

This  is  just  one  possible  output  structure.  Your  actual  output  structure  will  depend 
on  your  choices  for  base  folder  name,  condition  labels,  desired  filters,  and  the 
number  of  files  analyzed.  The  individual  and  summary  files  are  shown  below. 

/server/test/HVDAPSDResults/condition  l/HVDAPSD_Raw_condition  1  _datarun_0.txt 
/server/test/HVDAPSDResults/conditionl/HVDAPSD_Raw_conditionl_datarun_l  .txt 
/server/test/HVDAPSDResults/condition  1  /HVDAPSD_Raw_condition  1  _datarun_2.txt 
/server/test/HVDAPSDResults/condition  1  /HVDAPSD_Raw_condition  1  _datarun_3  .txt 
/server/test/HVDAPSDResults/condition  1  /HVDAPSD_Raw_condition  1  _Summary.txt 
/server/test/HVDAPSDResults/condition2/HVDAPSD_Raw_condition2_datarun_0.txt 
/server/test/HVDAPSDResults/condition2/HVDAPSD_Raw_condition2_datarun_l.txt 
/server/test/HVDAPSDResults/condition2/HVDAPSD_Raw_condition2_datarun_2.txt 
/server/test/HVDAPSDResults/condition2/HVDAPSD_Raw_condition2_datarun_3.txt 
/server/test/HVDAPSDResults/condition2/HVDAPSD_Raw_condition2_Summary.txt 
/server/test/HVDAPSDResults/condition3/H  VDAPSD_Raw_condition3_datarun_0.txt 
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/server/test/HVDAPSDResults/condition3/HVDAPSD_Raw_condition3_datarun_l.txt 

/server/test/HVDAPSDResults/condition3/HVDAPSD_Raw_condition3_datarun_2.txt 

/server/test/HVDAPSDResults/condition3/HVDAPSD_Raw_condition3_datarun_3.txt 

/server/test/HVDAPSDResults/condition3/HVDAPSD_Raw_condition3_Sumniary.txt 

14.2.2  Example  Output  File 

Figure  18  is  an  example  PSD  output  summary  file.  This  graphic  was  printed  to  a 
•file  from  Open  Office  Calc. 

14.3  RAO  Analysis  Output 

The  first  and  left  most  column  contains  the  frequencies  that  correspond  row  by 
row  with  the  root  RAO  magnitudes.  Each  other  column  represents  a  channel  of 
analyzed  data  and  contains  the  Channel  Name  and  square  root  of  the  RAO  mag- 

.  J  ,  .  ,  .  J  /  D  A  I  PSDFFTM S AM (DataC hannel) 

mtude,  Which  was  computed  using  VRAO  =  ^  psDFFTMSAMimvrsorChannel)  • 

Other  pertinent  information  is  in  the  header  at  the  top  of  the  output  file,  includ¬ 
ing  the  parameters  used  to  calculate  the  PSD  I-Skip  and  Segment  Length.  Each 
condition,  or  folder,  is  summarized  on  a  channel-by-channel  basis.  The  summary 
gives  values  for  each  frequency’s  PSD  magnitude  for  each  channel. 

For  each  condition,  the  program  will  create  one  results  file  for  each  input  file 
for  either  raw  or  low-pass  filter  states.  In  addition,  one  summary  file  is  created  for 
either  the  raw  or  low-pass  filter  state  in  each  condition  and  is  saved  in  the  results 
folder  for  that  condition.  As  with  individual  files,  pertinent  information  is  written 
at  the  top  of  the  summary  file. 

Output  is  stored  in  a  directory  structure  similar  to  the  input  data  structure.  The 
base  results  folder,  named  by  the  user  in  the  ’HVDARAOConfiguration.conf’  file, 
will  contain  all  of  the  output.  For  this  basic  analysis  the  results  will  be  in  the 
sub-folder  named  ’HVDARAOResults’.  At  the  next  level  the  results  are  broken 
down  into  their  respective  conditions  using  the  condition  labels  defined  in  the 
’HVDAGlobalConfiguration.conf  file.  These  folders  contain  the  actual  condition 
results,  sorted  by  filter  type,  original  data  file  name  and  index. 

14.3.1  Example  Output  Structure 

This  is  just  one  possible  output  structure.  Your  actual  output  structure  will  depend 
on  your  choices  for  base  folder  name,  condition  labels,  desired  filters,  and  the 
number  of  files  analyzed.  The  individual  and  summary  files  are  shown  below. 
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Figure  18:  Example  PSD  Output  File 
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/server/test/HVDARAOResults/condition  1  /HVDARAO_Raw_condition  1  _datarun_0.txt 
/server/test/HVDARAOResults/condition  1  /HVDARAO_Raw_condition  1  _datarun_  1  .txt 
/server/test/HVDARAOResults/condition  1  /HVDARAO_Raw_condition  1  _datarun_2.txt 
/server/test/HVDARAOResults/condition  1  /HVDARAO_Raw_condition  1  _datarun_3.txt 
/server/test/HVDARAOResults/conditionl/HVDARAO_Raw_condition  l_Summary.txt 
/server/test/HVDARAOResults/condition2/HVDARAO_Raw_condition2_datarun_0.txt 
/server/test/HVDARAOResults/condition2/HVDARAO_Raw_condition2_datarun_l  .txt 
/server/test/HVDARAOResults/condition2/HVDARAO_Raw_condition2_datarun_2.txt 
/server/test/HVDARAOResults/condition2/HVDARAO_Raw_condition2_datarun_3.txt 
/server/test/HVDARAOResults/condition2/HVDARAO_Raw_condition2_Summary.txt 
/server/test/HVDARAOResults/condition3/HVDARAO_Raw_condition3_datarun_0.txt 
/server/test/HVDARAOResults/condition3/HVDARAO_Raw_condition3_datarun_l  .txt 
/server/test/HVDARAOResults/condition3/HVDARAO_Raw_condition3_datarun_2.txt 
/server/test/HVDARAOResults/condition3/HVDARAO_Raw_condition3_datarun_3.txt 
/server/test/HVDARAOResults/condition3/HVDARAO_Raw_condition3_Summary.txt 

14.3.2  Example  Output  File 

Figure  1 9  is  an  example  RAO  output  summary  file.  This  graphic  was  printed  to  a 
file  from  Open  Office  Calc. 

14.4  Weibull  Analysis  Output 

The  Weibull  output  is  organized  by  channels.  Each  input  channel  yields  up  to  5 
output  columns  depending  on  the  calculation  performed.  The  result  columns  re¬ 
port  the  actual  data  amplitudes  used,  linearized  Weibull  X  data,  linearized  Weibull 
Y  data,  and  linear  Weibull  trend  lines. 

Other  pertinent  information  is  in  the  header  at  the  top  of  the  output  file,  includ¬ 
ing  the  parameters  used  to  calculate  the  Weibull  lifetime  statistics.  Each  condition, 
or  folder,  is  summarized  on  a  channel-by-channel  basis.  For  each  condition,  the 
program  will  create  one  results  file  for  either  raw,  low-pass,  or  high-pass  filter 
states. 

Output  is  stored  in  a  directory  structure  similar  to  the  input  data  structure.  The 
base  results  folder,  named  by  the  user  in  the  ’HVDAWeibullConfiguration.conf’ 
file,  will  contain  all  of  the  output.  For  this  basic  analysis  the  results  will  be  in  the 
sub-folder  named  ’HVDAWeibullResults’.  At  the  next  level  the  results  are  broken 
down  into  their  respective  conditions  using  the  condition  labels  defined  in  the 
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Figure  19:  Example  RAO  Output  File 
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’HVDAGlobalConfiguration.conf’  file.  These  folders  contain  the  actual  condition 
results,  sorted  by  filter  type,  original  data  file  name  and  index. 

14.4.1  Example  Output  Structure 

This  is  just  one  possible  output  structure.  Your  actual  output  structure  will  depend 
on  your  choices  for  base  folder  name,  condition  labels,  desired  filters,  and  the 
number  of  files  analyzed.  The  individual  and  summary  files  are  shown  below. 

/server/test/HVDAWeibullResults/condition  1  /HVDAWeibull_Raw_condition  1  _Summary.txt 
/server/test/HVDAWeibullResults/condition2/HVDAWeibull_Raw_condition2_Summary.txt 
/server/test/HVDAWeibullResults/condition3/HVDAWeibull_Raw_condi  tion3_Summary.txt 

14.4.2  Example  Output  File 

Figure  20  is  an  example  Weibull  output  summary  file.  This  graphic  was  printed  to 
a  file  from  Open  Office  Calc. 

15  Configuration  Files  and  Options 

HVDAS  has  the  ability  to  generate  example  configuration  files;  just  run  “hvdas  - 
createexampleconfigs”.  The  example  configuration  files  are  heavily  documented. 

Basic  documentation  is  provided  in  this  document,  while  more  extensive  doc¬ 
umentation  and  examples  are  also  provided  in  the  example  configuration  files. 

Every  HVDAS  configuration  file  is  a  lot  like  a  standard  UNIX  configuration  file. 

They  all  end  with  the  extension  “.conf”  and  can  have  comment  lines  that  start  with 
“#”.  If  you  choose  to  generate  example  configuration  files,  existing  configuration 
files  will  be  overwritten  without  warning. 

15.1  HVDAGlobalConfiguration.conf 

The  Global  Configuration  file  is  a  single  file  containing  parameters  and  settings 
that  define  the  entire  data  set.  The  global  configuration  values  are  as  follows. 

15.1.1  Data  Type 

This  is  a  setting  that  describes  the  data  storage  format.  A  full  description  of  the 
data  types  exists  in  the  example  configuration  files  and  in  the  Data  Formats  sec¬ 
tion. 
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Keyword:  DATA_TYPE 

This  setting  is  spelling  and  case  sensitive,  so  the  options  must  be  input  EX¬ 
ACTLY  as  listed  below.  Choose  only  one. 

•  ASCII_COLUMNS:  ASCII  data  stored  in  interleaved  format  (columns  are 
channels  and  rows  are  samples).  Usually  tab  delimited. 

•  BINARY_INTERLEAVED_HIGH_BYTE_FIRST:  Binary  real  data  stored 
in  interleaved  format  with  the  high  byte  first. 

•  B INARY _INTERLE AVED_LOW_B YTE_FIRST :  Binary  real  data  stored 
in  interleaved  format  with  the  low  byte  first. 

•  BINARY _INTERLEAVED_UNSIGNED_SHORT:  Binary  integer  data  stored 
in  interleaved  format  with  the  low  byte  first. 

15.1.2  Data  Size 

This  is  the  number  of  bytes  that  each  data  point  or  value  takes  up.  The  default 
value  is  fixed  at  4  bytes,  a  standard  single  precision  floating  point  number.  Future 
versions  will  allow  for  higher  precision.  This  setting  has  no  effect  for  ASCII  data. 
Keyword:  DATA_SIZE 

15.1.3  Sample  Rate 

The  number  of  samples  recorded  per  second  per  channel  during  acquisition.  This 
number  can  be  scaled  up  or  down  to  aid  in  the  conversion  from  model  scale  to  full 
scale  or  vice  verse.  If  you  wish  to  scale  the  results,  remember  to  change  every 
single  value  to  the  desired  scale.  You  would  need  to  convert  frequencies,  scale 
factors,  and  speeds  in  multiple  configuration  files  to  the  same  scale. 

Keyword:  SAMPLE_RATE 

15.1.4  Total  Number  of  Acquired  Channels 

This  number  must  include  dead  and/or  dummy  channels  that  were  saved  during 
acquisition.  These  channels  may  be  ignored  later. 

Keyword:  NUMBER_OF_CHANNELS 
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15.1.5  Header  Size 

The  header  size  is  an  integer  representing  the  number  of  bytes  for  a  binary  file 
header  or  the  number  of  lines  for  an  ASCII  file  header. 

Keyword:  HEADER_SIZE 

15.1.6  Drift  Compensation  Seconds 

The  drift  compensation  seconds  parameter  is  used  to  compensate  for  non-stationary 
mean  shift  behavior  that  you  wish  to  eliminate  from  your  data  after  the  data  has 
been  read  in  and  scaled.  A  value  <  0  will  not  compensate,  a  value  of  0  will  sub¬ 
tract  the  entire  time  history’s  mean,  and  a  value  >  0  will  subtract  the  local  mean 
for  the  desired  number  of  seconds. 

Keyword:  DRIFT_COMPENSATION_SECONDS 

15.1.7  Total  Number  of  Acquired  Channels 

This  number  must  include  dead  and/or  dummy  channels  that  were  saved  during 
acquisition.  These  channels  may  be  ignored  later. 

Keyword:  NUMBER_OF_CHANNELS 

15.1.8  Header  Size 

The  header  size  is  an  integer  representing  the  number  of  bytes  for  a  binary  file 
header  or  the  number  of  lines  for  an  ASCII  file  header. 

Keyword:  HEADER_SIZE 

15.1.9  Test  Condition  List 

This  is  a  list  containing  the  paths  to  each  test  condition  directory  to  be  analyzed  in 
the  entire  data  block  as  well  as  information  describing  each  test  condition.  Each 
entry  must  be  on  a  separate  line  and  contain  every  piece  of  information.  These 
entries  are  case  sensitive.  If  the  entered  directory  is  not  found  during  a  self-test, 
the  directory  will  not  be  analyzed  or  an  error  will  occur  depending  on  the  problem 
with  the  directory  path.  As  with  all  configuration  lists,  the  test  condition  list  must 
end  with  ’END’  on  a  separate  line  after  the  last  test  condition  entry.  The  user  must 
have  the  proper  permissions  to  access  the  data  directories  and  data  files  before 
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running  the  program  or  it  will  terminate  in  error.  The  test  condition  list  is  a  tab- 
delimited  matrix  of  information  describing  all  of  the  test  conditions,  which  lends 
itself  to  being  edited  with  a  spreadsheet  application. 

Keyword:  TEST_CONDITION_LIST 

This  list  contains  the  following  parameters  to  describe  each  test  condition. 

CONDITION_LABEL 

FILE_PREFIX 

FILE_EXTENSION 

FILE_ID_LOWER_B  OUND 

FILE_ID_UPPER_BOUND 

CONDITION_START_SKIP_TIME 

CONDITION_END_KEEP_TIME 

SEA_STATE 

SPEED_IN_KNOTS 

HEADING_IN_DEGREES 

CONDITION_PROBABILITY 

15.1.10  Lowest  and  Highest  Data  File  Indexes 

The  lowest  and  highest  number  following  the  file  prefix  in  the  file  names  of  the 
data  files  in  the  condition  directory. 

Keyword:  FILE_ID_LOWER_B OUND :  FILE_ID_UPPER_BOUND 

15.1.11  Data  File  Prefix 

The  part  of  the  file  name  after  the  directory  path  and  before  the  indexing  number, 
include  any  characters  before  beginning  the  number  including  spaces  and  special 
characters. 

Keyword:  FILE_PREFIX 

15.1.12  Data  File  Extension 

The  file  extension  of  the  data  files  in  the  corresponding  condition  folder. 
Keyword:  FILE_EXTEN SION 
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15.1.13  Condition  Label 

The  user  defined  ’name’  for  the  condition.  This  has  no  bearing  on  the  actual  anal¬ 
ysis,  but  the  program  will  terminate  if  two  folders  have  the  exact  same  condition 
label. 

Keyword:  CONDITION_LABEL 

15.1.14  Condition  Probability 

The  user  defined  probability  for  the  condition  as  a  percentage  of  the  ship’s  life¬ 
time.  This  value  is  used  in  Weibull  estimation  of  maximum  lifetime  statistics. 
Keyword:  CONDITION_PROBABILITY 

15.1.15  Sea  State 

This  sets  the  sea  state  of  the  data  in  the  current  condition.  For  example,  in  ana¬ 
lyzing  ship  structure  data  collected  in  a  Sea  State  7,  set  this  value  to  7  or  SS7.  If 
you  are  not  analyzing  ship  structure  data,  you  may  enter  an  identifier  that  will  de¬ 
fine  the  type  of  test  or  condition  you  are  analyzing.  The  combination  of  sea  state, 
speed,  and  heading  will  be  used  to  generate  trend  tables  for  all  parts  of  HVDAS. 
Keyword:  SEA_STATE 

15.1.16  Speed  In  Knots 

This  sets  the  speed  of  the  data  in  the  current  condition.  For  example,  in  analyzing 
ship  structure  data  collected  at  15  Knots,  set  this  value  to  15.  Make  sure  that  your 
speed  matches  your  chosen  scale.  Do  everything  in  either  model  or  full  scale  for 
ship  structures.  The  default  value  is  0.0.  The  speed  is  used  by  RAO  analysis  in 
the  conversion  from  encounter  to  wave  frequency. 

Keyword:  SPEED JN_KNOTS 

15.1.17  Heading  in  Degrees 

This  setting  sets  the  heading  of  the  data  in  the  current  condition  in  degrees.  For 
example,  0.0  degrees  is  assumed  to  mean  that  the  ship  is  heading  straight  into  the 
waves,  which  is  known  as  “head  seas”.  The  default  value  is  0.0.  The  heading  is 
used  by  RAO  analysis  in  the  conversion  from  encounter  to  wave  frequency. 
Keyword:  HEADING_IN_DEGREES 
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15.1.18  Condition  Start  Skip  Time  Selection 

This  field  represents  the  amount  of  time  you  would  like  to  skip  at  the  beginning 
of  a  condition;  in  seconds.  This  feature  is  very  useful  if  you  have  data  files  that 
were  collected  in  even  intervals.  For  example,  the  RV  Triton  data  conditions  are 
comprised  of  data  files  that  were  recorded  in  5  minute  increments.  The  condition 
you  may  want  to  analyze  might  require  you  to  skip  the  first  2  minutes  of  the  first 
data  file  and  keep  the  first  4  minutes  of  the  last  data  file.  This  setting  allows  you 
to  do  that.  Example:  ’CONDITION_START_SKIP_TIME:\t60’  to  skip  the  first 
minute  of  the  first  data  file  in  the  condition.  Leave  the  default  value  of  0.0  if  you 
would  like  to  analyze  the  entire  condition  worth  of  data.  Note:  In  order  to  use  this 
feature,  you  must  set  FILE_ID_UPPER&LOWER  to  the  first  and  last  files  in  the 
current  condition  respectively. 

Key  Word:  CONDITION_START_SKIP_TIME 

15.1.19  Condition  End  Keep  Time  Selection 

This  field  represents  the  amount  of  time  you  would  like  to  keep  at  the  end  of 
a  condition;  in  seconds.  This  feature  is  very  useful  if  you  have  data  files  that 
were  collected  in  even  intervals.  For  example,  the  RV  Triton  data  conditions  are 
comprised  of  data  files  that  were  recorded  in  5  minute  increments.  The  condi¬ 
tion  you  may  want  to  analyze  might  require  you  to  skip  the  first  2  minutes  of  the 
first  data  file  and  keep  the  first  4  minutes  of  the  last  data  file.  This  setting  al¬ 
lows  you  to  do  exactly  that.  Example:  ’CONDITION_END_KEEP_TIME:\t240’ 
to  keep  the  first  four  minutes  and  truncate  the  last  minute  of  the  last  data  file 
in  the  condition.  Leave  the  default  value  of  0.0  if  you  would  like  to  analyze 
the  entire  condition  worth  of  data.  Note:  In  order  to  use  this  feature,  you  must 
set  FILE_ID_UPPER&LOWER  to  the  first  and  last  files  in  the  current  condi¬ 
tion  respectively.  If  you  have  a  condition  that  contains  only  one  data  file,  set  the 
FILE_IDs  to  the  same  file,  then  the  skip  time  will  be  applied  followed  immedi¬ 
ately  by  the  end  keep  time;  in  this  case  the  end  keep  time  should  be  the  total  time 
occupied  by  the  condition  or  0.0  to  use  all  of  it  automatically. 

Key  Word:  CONDITION_END_KEEP_TIME 

15.1.20  Channel  List 

The  channel  list  is  a  tab-delimited  list  of  channel  names,  scale  factors,  and  zero 
values.  ALL  channel  names  must  be  listed,  even  if  the  channel  is  empty,  dead  or 
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will  not  be  analyzed.  Only  30  characters  will  be  output  to  a  spreadsheet,  so  any 
characters  after  this  30-character  limit  will  result  in  an  error  or  be  truncated.  The 
list  must  end  with  ’END’  on  the  line  after  the  last  channel  entry. 

Keyword:  CHANNEL_LIST 

15.1.21  ALL  Scale  Factors 

These  scale  factors  are  used  when  reading  the  data  stored  in  the  data  files  into 
memory.  If  the  recorded  data  is  already  in  the  desired  units,  use  scale  factors 
of  1 .0.  This  follows  the  same  restrictions  as  those  for  the  channel  names.  For  an 
empty  or  dead  channel  put  a  1 .00  as  the  scale  factor.  The  list  must  end  with  ’END’ 
on  the  line  after  the  last  scale  factor.  These  numbers  are  applied  to  every  channel 
in  every  data  file  for  the  current  condition.  If  no  scaling  is  needed  for  selected 
channels,  the  corresponding  scale  factors  in  this  file  should  be  set  to  1. 

Keyword:  SCALE_FACTORS 

15.1.22  List  of  Initial  Condition  Zero  Values 

This  list  of  coefficients  is  used  to  subtract  an  initial  condition  zero  value  from 
every  channel  you  want  to  analyze.  This  subtraction  will  be  performed  on  every 
filter  state  you  choose,  which  means  it  must  be  used  in  conjunction  with  at  least 
one  other  filter  state. 

Keyword:  ZERO_VALUES 

15.1.23  List  of  Smoothing,  Low-Pass  and  High-Pass  Filter  Coefficients 

Between  the  filter  coefficients  keyword  and  ’END’,  a  list  of  calculated  filter  co¬ 
efficients  must  be  copied,  one  coefficient  per  line,  for  each  desired  filter.  These 
coefficients  must  be  created  using  another  program  like  Wave  Metrics  IGOR  Pro 
IFDL  and  copied  into  the  configuration  file. 

Keyword(s): 

LOW_PASS_COEFFICIENTS, 

HIGH_PASS_COEFFICIENTS, 

SMOOTHED_COEFFICIENTS 

15.1.24  Example  HVDAGlobalConfiguration.conf 

Figure  21  shows  an  example  global  configuration  file. 
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Figure  21 :  Example  HVDAGlobalConfiguration.conf 
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15.2  HVDAMMMConfiguration.conf 

The  HVDAMMMConfiguration.conf  file  contains  the  parameters  and  settings  spe¬ 
cific  to  the  basic  MMM  statistical  analysis.  The  settings  in  this  file  are  constant 
for  the  entire  data  block.  Therefore,  there  need  be  only  one  copy  of  this  file  in  the 
base  directory  of  the  analysis  software.  HVDAMMMConfiguration.conf  includes 
the  following  parameters. 

15.2.1  List  of  Channels  to  Analyze 

A  number  in  this  list  refers  to  a  channel  in  your  data  file.  Channel  ’O’  (zero)  refers 
to  the  first  saved  channel.  The  number  of  channels  minus  one  references  the  last 
saved  channel.  So,  if  there  are  16  channels,  the  first  channel  is  0  and  the  last  is 
15.  The  numbers  can  be  listed  in  any  order  as  long  as  the  requested  channel  is  less 
than  the  total  number  of  channels,  greater  than  or  equal  to  0,  and  exists  in  all  data 
files  in  all  conditions  you  wish  to  analyze. 

Keyword:  CHANNELS_TO_RUN 

15.2.2  List  of  Filter  States  to  Apply 

The  filter  states  are  referred  to  using  a  list  of  integers. 

•  0  -  No  Filtering,  use  raw  data 

•  1  -  Smooth-Pass  FIR  Filter  the  raw  data  using  the  Smoothing  Coefficients 
to  remove  noise 

•  2  -  Low-Pass  FIR  Filter  using  the  Low-Pass  Coefficients  to  remove  high- 
frequency  energy 

•  3  -  High-Pass  FIR  Filter  using  the  High-Pass  Coefficients  to  remove  low- 
frequency  energy 

•  4  -  Box  Car  Average  smoothing  of  the  data  to  remove  drop-outs  and  noise 

•  5  -  Initial  Conditions  Zero  Subtraction  subtracts  user  defined  values  from 
each  channel  for  every  filter  state  requested,  which  means  this  option  must 
be  used  in  conjunction  with  at  least  one  other  filter  state 
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•  6  -  Compute  Virtual  Channel  Expressions  from  raw  input  data  before  con¬ 
verting  data  files;  this  option  must  be  used  in  conjunction  with  at  least  one 
other  filter  state  and  can  only  be  used  when  converting  data. 

Use  one  or  all  of  these  by  putting  one  integer  per  line  in  the  configuration  file. 
Each  filter  type  will  produce  one  spreadsheet  of  output  per  file  and  a  summary  of 
the  filter  condition.  End  the  list  of  filters  with  ’END’. 

Keyword:  FILTERS 

15.2.3  Box  Car  Average  Window  Size 

This  is  used  to  select  the  number  of  data  points  on  each  side  of  the  box  car.  This 
value  can  be  even  or  odd,  it  does  not  matter. 

Keyword:  BOX_CAR_WINDOW_SIZE 

15.2.4  Virtual  Channel  Expressions 

Key  Word:  ’VIRTUAL_CHANNEL_EXPRESSIONS’ 

This  list  should  contain  a  list  of  expressions  you  want  to  use  to  compute  vir¬ 
tual  channels.  These  virtual  channel  expressions  use  postfix  notation  to  eliminate 
the  need  to  figure  out  order  of  operations  and  to  eliminate  the  need  for  parenthe¬ 
sis.  Postfix  notation  allows  the  user  to  completely  control  the  execution  of  the 
expression  without  parenthesis  or  brackets.  It  is  used  because  of  the  simplicity 
of  implementation.  Virtual  Channels  will  only  be  computed  when  converting  the 
data  using  -convertdata  to  output  ASCII  data  files.  The  new  converted  ASCII  data 
files  can  then  be  run  through  the  MMM  analysis  software  by  changing  data  file 
descriptions  and  running  hvdas  in  MMM  MPI  mode  just  like  any  other  data  files. 

Virtual  Channel  Support  is  not  heavily  tested  and  is  extremely  picky.  You 
must  follow  the  expression  spec  EXACTLY.  You  cannot  perform  expressions  on 
constants.  Be  sure  to  do  a  test  channel  to  make  sure  that  your  expression  is  correct. 
Every  complex  expression  is  made  up  of  simple  expressions. 
//////////////////////////////////// 

//expression  format  spec  from  the  source  code 
//operand  d,  which  can  be  a  constant(l ,  1 .5,  45.987, ...) 

//or  a  channel  (cO,  cl,  c2,...) 

//operator  r,  which  can  be  (+,  -,  *,  /,  and  A  for  simple  expressions) 

//or  (+,  -,  *,  /,  and  sqrt)  for  complex  expressions 
//space  s 
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//tab  t 
//comma , 

//semicolon  ; 

//////////////////////////// 

//Simple  Expression 

//d,sd,sd,tr,sr 

//or 

//Complex  Expression  composed  of  Simple  Expressions 

//d,sd,sd,tr,sr;sd,sd,sd,tr,sr;tEOsr 

//////////////////////////// 

Example  simple  expression  (cO  +  cl  +  c2)  should  be  input  as 
’c2,  cl,  cO,<tab>+,  +’ 

Example  simple  expression  (cO  +  2  +  1.1)  should  be  input  as 
’1.1,2,  cO,<tab>+,  +’ 

Example  simple  expression  c2*|'5  should  be  input  as 
’2.2,  5.5,  c2,<tab>*, /’ 

Example  complex  expression  (ell  +  3.3)  x  (c9  +  3.3)  should  be  input  as 
’3.3,  c9,<tab>+;  3.3,  cl  1  ,<tab>+;<tab>EO  *’ 

Example  complex  expression  yj should  be  input  as 
’5.5,  c4,<tab>*;  cl,  c2,<tab>*;<tab>EO /,  sqrt’ 

Example  complex  expression  fy  +  ||  should  be  input  as 
’2.2,  cO,<tab>/;  1.1,  c3,<tab>/;<tab>EO  +’ 

c3+l.l 

cO+1.5 

Example  complex  expression  should  be  input  as 

’3.3,  c9,<tab>A;  2.2,  c5,<tab>+;  1.5,  cO,<tab>+;  1.1,  c3,<tab>+;<tab>EO  /,  /, 

/’ 

Example  complex  expression 

“*  Y^Tt  ±  TTvLrt  *\KC  1  ~  c2)2  +  (c2  ~  c3)2  should  be  input  as 
’(l-Vconst)value,  cl,  c3,<tab>+,  /;  (sqrt(2)/(l+Vconst)A2value,  2,  c2,  cl,<tab>- 
,  A,  *;  (sqrt(2)/(l+Vconst)A2 value,  2,  c3,  c2,<tab>-,  A,  *;<tab>EO  +,  sqrt,  +’  and 
as 

’(1  -Vconst)value,  cl ,  c3,<tab>+,  /;  (sqrt(2)/(l+Vconst)A2value,  2,  c2,  cl  ,<tab>- 
,  A,  *;  (sqrt(2)/(l+Vconst)A2value,  2,  c3,  c2,<tab>-,  A,  *;<tab>EO  +,  sqrt,  -’ 

15.2.5  Output  Path 

The  output  path  contains  the  complete  path  to  the  folder  where  the  user  wants  the 
results  saved.  The  output  path  must  begin  and  end  with  a  ’/’.  This  folder  will 
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be  appended  if  it  already  exists.  Any  existing  sub-folder  of  the  same  name  as  a 
program -created  folder  will  be  overwritten.  For  this  reason  it  is  recommended 
that  the  folder  named  here  be  empty  prior  to  running  the  program.  This  will  allow 
the  program  to  build  the  file  structure  without  incident.  The  user  must  have  the 
proper  permissions  to  access  the  output  directory  before  running  the  program  or 
it  will  terminate  in  error. 

The  user  may  optionally  select  as  the  output  path  when  converting  data 
files.  This  output  path  will  write  output  files  into  the  same  directories  as  the  input 
data  files.  This  option  is  very  useful  when  analyzing  converted  data  after  conver¬ 
sion  because  the  configuration  files  to  this  software  will  not  need  to  be  modified 
very  much. 

Keyword:  OUTPUT_PATH 

15.2.6  Example  HVDAMMMConfiguration.conf 

Figure  22  shows  an  example  MMM  configuration  file. 

15.3  HVDAPSDConfiguration.conf 

The  HVDAPSDConfiguration.conf  file  contains  the  parameters  and  settings  spe¬ 
cific  to  the  PSD  frequency  domain  analysis.  The  settings  in  this  file  are  constant 
for  the  entire  data  block.  Therefore,  there  need  be  only  one  copy  of  this  file  in  the 
base  directory  of  the  analysis  software.  HVDAPSDConfiguration.conf  includes 
the  following  parameters. 

15.3.1  List  of  Channels  to  Analyze 

A  number  in  this  list  refers  to  a  channel  in  your  data  file.  Channel  ’0’  (zero)  refers 
to  the  first  saved  channel.  The  number  of  channels  minus  one  references  the  last 
saved  channel.  So,  if  there  are  16  channels,  the  first  channel  is  0  and  the  last  is 
1 5.  The  numbers  can  be  listed  in  any  order  as  long  as  the  requested  channel  is  less 
than  the  total  number  of  channels,  greater  than  or  equal  to  0,  and  exists  in  all  data 
files  in  all  conditions  you  wish  to  analyze. 

Keyword:  CHANNELS_TO_RUN 

15.3.2  List  of  Filters  to  Apply 

The  filters  are  referred  to  using  a  list  of  integers. 


66 


NSWCCD-65-TR-2003/02 


OUTPUT-PATH: 

CHANNELS_TO_RUN: 

END 

FILTERS: 

END 


Sheetl 

/server/test/ 


0 

1 

2 


0 


VIRTUAL„CHANNEL_EXPRESS!ONS: 

1.1,  cO,  + 

3.3,  c9,  +;  3.3,  ell,  +;  EO* 

3.3,  c9,  2.2,  c5,  +;  1.1,  cO,  +;  1.1,  c3,  +;  EO  /,  /,  / 

END 


BOX_CAR_WINDOW_SIZE:  100 


Page  1 


67 


Figure  22:  Example  HVDAMMMConfiguration.conf 
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•  0  -  No  Filtering,  use  raw  data 

•  1  -  Low-Pass  Filter  using  the  Low-Pass  Coefficients  to  remove  high-frequency 
energy 

Use  only  one  of  these  two  possible  filter  states  at  a  time  by  putting  only  one  integer 
in  the  configuration  file.  Each  filter  type  will  produce  one  spreadsheet  of  output 
per  file  and  a  summary  of  the  filter  condition.  End  the  one  line  filter  list  with 
’END’. 

Keyword:  FILTERS 

15.3.3  Output  Path 

The  output  path  contains  the  complete  path  to  the  folder  where  the  user  wants  the 
results  saved.  The  output  path  must  begin  and  end  with  a  7’.  This  folder  will 
be  appended  if  it  already  exists.  Any  existing  sub-folder  of  the  same  name  as  a 
program-created  folder  will  be  overwritten.  For  this  reason  it  is  recommended 
that  the  folder  named  here  be  empty  prior  to  running  the  program.  This  will  allow 
the  program  to  build  the  file  structure  without  incident.  The  user  must  have  the 
proper  permissions  to  access  the  output  directory  before  running  the  program  or 
it  will  terminate  in  error. 

Keyword:  OUTPUT_PATH 

15.3.4  Highest  Frequency  of  Interest  Selection 

The  Highest  Frequency  Of  Interest  (HFI)  is  used  to  scale  the  output  PSD.  The  PSD 
can  have  frequencies  beyond  the  HFI,  but  you  should  be  certain  of  the  samples  per 
cycle  at  the  HFI  because  of  the  OVER_SAMPLING  input.  Note:  The  frequencies 
referenced  here  are  relative  to  the  SAMPLE_RATE  in  HVDAGlobalConfigura- 
tion.conf.  Choose  either  model  or  full  scale  units  by  changing  the  sample  rate, 
scale  factors,  and  these  frequencies. 

Keyword:  HIGHEST_FREQUENCY_OF_INTEREST 

15.3.5  Over  Sampling  Selection 

The  Over  Sampling  (OS)  is  used  to  scale  the  output  PSD.  The  HFI  and  OS  de¬ 
termine  the  re-sampling,  i-skip,  factor  needed  to  give  OS  samples  per  cycle  at  the 
HFI  in  the  output  PSD. 

Keyword:  OVER_SAMPLING 
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15.3.6  Target  Delta  Frequency  Selection 

The  Target  Delta  Frequency  (TDF)  is  used  to  compute  the  number  of  points 
needed  to  calculate  the  PSD  to  arrive  at  the  closest  possible  actual  delta  frequency 
to  the  TDF.  You  must  determine,  by  hand,  a  good  TDF  for  your  data  set.  You 
must  decide  on  the  best  trade-off  between  accuracy  and  resolution.  You  may  want 
to  choose  a  TDF  that  will  cause  a  PSD  data  point  to  be  calculated  at  a  known 
frequency,  such  as  the  frequency  when  wave  length  is  equal  to  ship  length. 

Note:  If  the  HFI,  OS,  TDF  combination  requires  a  large  number  of  data  points, 
some  data  files  may  not  have  enough  data.  In  this  case,  the  input  data  are  dupli¬ 
cated  until  enough  data  points  exist  to  perform  the  desired  computations.  The 
effect  of  this  solution  is  minimal  on  the  PSD  because  the  statistics  of  the  input 
waves  are  not  changed.  The  resolution  you  get  from  a  duplicated  data  PSD  is 
artificial.  Its  added  resolution  comes  from  the  assumption  that  the  data  run  would 
have  continued  with  identical  frequency  content  for  as  long  as  needed.  This  as¬ 
sumption  affects  confidence  bounds  statistics.  This  is  sometimes  necessary  to  get 
every  single  PSD  from  each  condition  to  have  the  same  frequencies,  which  makes 
summarizing  and  reporting  much  easier  for  the  user. 

Keyword:  TARGET_DELTA_FREQUEN C Y 

15.3.7  Example  HVDAPSDConfiguration.conf 

Figure  23  shows  an  example  PSD  configuration  file. 

15.4  HVDARAOConfiguration.conf 

The  HVDARAOConfiguration.conf  file  contains  the  parameters  and  settings  spe¬ 
cific  to  the  RAO  frequency  domain  analysis.  The  settings  in  this  file  are  constant 
for  the  entire  data  block.  Therefore,  there  need  be  only  one  copy  of  this  file  in  the 
base  directory  of  the  analysis  software.  HVDARAOConfiguration.conf  includes 
the  following  parameters. 

15.4.1  List  of  Channels  to  Analyze 

A  number  in  this  list  refers  to  a  channel  in  your  data  file.  Channel  ’O’  (zero)  refers 
to  the  first  saved  channel.  The  number  of  channels  minus  one  references  the  last 
saved  channel.  So,  if  there  are  16  channels,  the  first  channel  is  0  and  the  last  is 
1 5.  The  numbers  can  be  listed  in  any  order  as  long  as  the  requested  channel  is  less 
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Figure  23:  Example  HVDAPSDConfiguration.conf 
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than  the  total  number  of  channels,  greater  than  or  equal  to  0,  and  exists  in  all  data 
files  in  all  conditions  you  wish  to  analyze. 

Keyword:  CHANNELS_TO_RUN 

15.4.2  List  of  Filters  to  Apply 

The  filters  are  referred  to  using  a  list  of  integers. 

•  0  -  No  Filtering,  use  raw  data 

•  1  -  Low-Pass  Filter  using  the  Low-Pass  Coefficients  to  remove  high-frequency 
energy 

Use  only  one  of  these  two  possible  filter  states  at  a  time  by  putting  only  one  integer 
in  the  configuration  file.  Each  filter  type  will  produce  one  spreadsheet  of  output 
per  file  and  a  summary  of  the  filter  condition.  End  the  one  line  filter  list  with 
’END’. 

Keyword:  FILTERS 

15.4.3  List  of  RAO  Filters  to  Apply 

The  filters  are  referred  to  using  a  list  of  integers. 

•  0  -  No  Filtering,  use  raw  RAO 

•  1  -  Low-Pass  Filter  the  output  RAO  using  the  RAO  Pass  Coefficients  to 
remove  high-frequency  oscillations  in  high-resolution  RAOs 

Use  only  one  of  these  two  possible  filter  states  at  a  time  by  putting  only  one  integer 
in  the  configuration  file.  Each  filter  type  will  produce  one  spreadsheet  of  output 
per  file  and  a  summary  of  the  filter  condition.  End  the  one  line  filter  list  with 
’END’. 

Keyword:  RAOFILTERS 

15.4.4  List  of  RAO  Pass  Coefficients 

Between  the  RAO  filter  coefficients  keyword  and  ’END’,  a  list  of  calculated  filter 
coefficients  must  be  copied,  one  coefficient  per  line,  for  each  activated  filter.  These 
coefficients  must  be  created  using  another  program  like  Wave  Metrics  IGOR  Pro 
IFDL  and  copied  into  the  configuration  file. 

Keyword(s):  RAO_PASS_COEFFICIENTS 
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15.4.5  Output  Path 

The  output  path  contains  the  complete  path  to  the  folder  where  the  user  wants  the 
results  saved.  The  output  path  must  begin  and  end  with  a  7’.  This  folder  will 
be  appended  if  it  already  exists.  Any  existing  sub-folder  of  the  same  name  as  a 
program -created  folder  will  be  overwritten.  For  this  reason  it  is  recommended 
that  the  folder  named  here  be  empty  prior  to  running  the  program.  This  will  allow 
the  program  to  build  the  file  structure  without  incident.  The  user  must  have  the 
proper  permissions  to  access  the  output  directory  before  running  the  program  or 
it  will  terminate  in  error. 

Keyword:  OUTPUT_PATH 

15.4.6  Highest  Frequency  of  Interest  Selection 

The  Highest  Frequency  of  Interest  (HFI)  is  used  to  scale  the  output  RAO.  The 
RAO  can  have  frequencies  beyond  the  HFI,  but  you  should  be  certain  of  the  sam¬ 
ples  per  cycle  at  the  HFI  because  of  the  OVER_SAMPLING  input.  Note:  The 
frequencies  referenced  here  are  relative  to  the  SAMPLE_RATE  in  HVDAGlob- 
alConfiguration.conf.  Choose  either  model  or  full  scale  units  by  changing  the 
sample  rate,  scale  factors,  and  these  frequencies. 

Keyword:  HIGHEST_FREQUENCY_OF_INTEREST 

15.4.7  Over  Sampling  Selection 

The  Over  Sampling  (OS)  is  used  to  scale  the  output  RAO.  The  HFI  and  OS  de¬ 
termine  the  re-sampling,  i-skip,  factor  needed  to  give  OS  samples  per  cycle  at  the 
HFI  in  the  output  RAO. 

Keyword:  OVER_SAMPLING 

15.4.8  Target  Delta  Frequency  Selection 

The  Target  Delta  Frequency  (TDF)  is  used  to  compute  the  number  of  points 
needed  to  calculate  the  PSD  to  arrive  at  the  closest  possible  actual  delta  frequency 
to  the  TDF.  You  must  determine,  by  hand,  a  good  TDF  for  your  data  set.  You 
must  decide  on  the  best  trade-off  between  accuracy  and  resolution.  You  may  want 
to  choose  a  TDF  that  will  cause  a  PSD  data  point  to  be  calculated  at  a  known 
frequency,  such  as  the  frequency  when  wave  length  is  equal  to  ship  length. 

Note:  If  the  HFI,  OS,  TDF  combination  requires  a  large  number  of  data  points, 
some  data  files  may  not  have  enough  data.  In  this  case,  the  input  data  are  dupli- 
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cated  until  enough  data  points  exist  to  perform  the  desired  computations.  The 
effect  of  this  solution  is  minimal  on  the  PSD  because  the  statistics  of  the  input 
wave  are  not  changed.  The  resolution  you  get  from  a  duplicated  data  RAO  is  ar¬ 
tificial.  Its  added  resolution  comes  from  the  assumption  that  the  data  run  would 
have  continued  with  identical  frequency  content  for  as  long  as  needed.  This  as¬ 
sumption  affects  confidence  bounds  statistics.  This  is  sometimes  necessary  to  get 
every  single  RAO  from  each  condition  to  have  the  same  frequencies,  which  makes 
summarizing  and  reporting  much  easier  for  the  user. 

Keyword:  TARGET_DELTA_FREQUENCY 

15.4.9  Divisor  Data  Channel  Selection 

The  Divisor  Data  Channel  (DDC)  is  used  to  divide  every  PSD  calculated  for  a 
given  data  file.  Dividing  a  PSD  by  the  PSD  of  the  DDC  creates  a  transfer  func¬ 
tion  called  an  RAO.  In  ship  structures,  if  you  divide  the  PSD(vertical  bending)  / 
PSD(wave  height)  then  the  RAO  output  is  in  terms  of  bending  response  per  foot 
of  input  wave  height.  The  units  of  the  transfer  function  RAO  depend  on  the  units 
of  the  input  data  and  are  not  limited  to  ship  structure  data. 

Keyword:  DI VIS OR_DATA_CH ANNEL 

15.4.10  Convert  From  Encounter  to  Wave  Frequency  Selection 

Enter  a  ’]’  to  convert  from  encounter  frequency  to  wave  frequency  or  a  ’0’  to 
skip  conversion.  This  enables  the  use  of  speed  and  heading  from  each  condition’s 
local  configuration.  A  speed  of  0.0  with  a  heading  of  0.0  will  result  in  the  wave 
frequency  equal  to  the  encounter  frequency. 

Keyword:  CONVERT_FROM_ENCOUNTER_TO_WAVE_FREQUENCY 

15.4.11  Example  HVDARAOConfiguration.conf 

Figure  24  shows  an  example  RAO  configuration  file. 

15.5  HVDAWeibullConfiguration.conf 

The  HVDAWeibullConfiguration.conf  file  contains  the  parameters  and  settings 
specific  to  the  Weibull  distribution  analysis.  The  settings  in  this  file  are  constant 
for  the  entire  data  block.  Therefore,  there  need  be  only  one  copy  of  this  file 
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Sheetl 


OUTPUT_PATH : 


/server/test/ 


CHANNELS_TCLRUN: 

END 

FILTERS: 

END 

RAOFILTERS: 

END 


0 

1 

2 


0 


0 


RAO_PASS_COEFFICIENTS: 

4.95E-005 

2.B3E-006 

2.35E-006 

2.35E-006 

2.34E-006 

2.34E-006 

2.35E-006 

2.35E-006 

2.33E-006 

4.95E-005 

END 


HIGHEST_FREQUENCY_OFJNTEREST:  0.44 

OVER„S  AM  PLING :  10 

TARGET_DELTA_FREQUENCY:  0 

DIVlSOR_DATA__CHANNEL:  0 

CONVERT_FROM_ENCOUNTER_TCL.WAVEJrREQUENCY:  1 
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Figure  24:  Example  HVDARAOConfiguration.conf 
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in  the  base  directory  of  the  analysis  software.  HVDAWeibullConfiguration.conf 
includes  the  following  parameters. 

15.5.1  List  of  Channels  to  Analyze 

A  number  in  this  list  refers  to  a  channel  in  your  data  file.  Channel  ’0’  (zero)  refers 
to  the  first  saved  channel.  The  number  of  channels  minus  one  references  the  last 
saved  channel.  So,  if  there  are  16  channels,  the  first  channel  is  0  and  the  last  is 
1 5.  The  numbers  can  be  listed  in  any  order  as  long  as  the  requested  channel  is  less 
than  the  total  number  of  channels,  greater  than  or  equal  to  0,  and  exists  in  all  data 
files  in  all  conditions  you  wish  to  analyze. 

Keyword:  CHANNELS_TO_RUN 

15.5.2  List  of  Filters  to  Apply 

The  filters  are  referred  to  using  a  list  of  integers. 

•  0  -  No  Filtering,  use  raw  data 

•  1  -  Low-Pass  Filter  using  the  Low-Pass  Coefficients  to  remove  high-frequency 
energy 

•  2  -  High-Pass  Filter  using  the  High-Pass  Coefficients  to  remove  low-frequency 
energy 

•  3  -  Already  Filtered  data 

Use  only  one  of  these  possible  filter  states  at  a  time  by  putting  only  one  integer  in 
the  configuration  file.  Each  filter  type  will  produce  one  spreadsheet  of  output  per 
file  and  a  summary  of  the  filter  condition.  End  the  one  line  filter  list  with  ’END’. 
Keyword:  FILTERS 

15.5.3  Output  Path 

The  output  path  contains  the  complete  path  to  the  folder  where  the  user  wants  the 
results  saved.  The  output  path  must  begin  and  end  with  a  7’.  This  folder  will 
be  appended  if  it  already  exists.  Any  existing  sub-folder  of  the  same  name  as  a 
program -created  folder  will  be  overwritten.  For  this  reason  it  is  recommended 
that  the  folder  named  here  be  empty  prior  to  running  the  program.  This  will  allow 
the  program  to  build  the  file  structure  without  incident.  The  user  must  have  the 
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proper  permissions  to  access  the  output  directory  before  running  the  program  or 
it  will  terminate  in  error. 

Keyword:  OUTPUT_PATH 

15.5.4  Weibull  Calculation  Type 

There  are  currently  four  different  Weibull  calculation  methods  to  choose  from:  2- 
Parameter  Linear  Regression,  2-Parameter  Moment  Method,  3-Parameter  Linear 
Regression,  and  3-Parameter  Moment  Method. 

Keyword:  WEIBULL_TYPE 

15.5.5  Weibull  Amplitude  Type 

There  are  currently  six  types  of  amplitudes  you  may  use  Weibull  analysis  with: 
Maximums,  Minimums,  Maximums-Mean,  Minimums-Mean,  Ranges,  Raw,  Whip¬ 
ping,  and  Impacts.  The  Raw  amplitude  type  allows  you  to  provide  your  own  set 
of  amplitudes  to  HVDAS. 

Keyword:  AMPLITUDE_TYPE 

15.5.6  Beta  Lower  Bound 

This  is  the  lower  search  bound  when  iteratively  solving  for  Beta,  the  Weibull  shape 
parameter,  using  the  Moment  Method  calculation. 

Keyword:  BETA_LOWER_BOUND 

15.5.7  Beta  Upper  Bound 

This  is  the  upper  search  bound  when  iteratively  solving  for  Beta  using  the  Moment 
Method  calculation. 

Keyword:  BETA_UPPER_BOUND 

15.5.8  Beta  Step  Size 

This  is  the  Beta  increment  size  when  iteratively  solving  for  Beta  using  the  Moment 
Method  calculation. 

Keyword:  BETA_STEP_SIZE 
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15.5.9  Ship  Lifetime 

This  specifies  the  expected,  designed,  or  desired  ship  lifetime  in  years,  which  is 
used  in  maximum  lifetime  estimation. 

Keyword:  SHIP_LIFETIME 

15.5.10  Extreme  F 

This  specifies  the  exceedance  probability  value  to  use  when  computing  Extreme 
Value  Analysis  Of  The  Parent  Weibull  Distribution. 

Keyword:  EXTREME_F 

15.5.11  Blanket  Amplitude  Cutoff 

This  selects  a  Weibull  threshold  that  will  cut  off  detected  amplitudes  that  are  below 
the  cutoff  value  for  every  filter  state  and  amplitude  type. 

Key  Word:  BLANKET_AMPLITUDE_CUTOFF 

15.5.12  XNot  Percent  Step  Size 

This  selects  a  step  size  used  in  xnot  calculation  as  a  percentage  of  the  smallest 
detected  amplitude  that  is  above  the  cutoff.  This  setting  is  only  used  during  3- 
Parameter  analysis. 

Key  Word:  XNOT_PERCENT_STEP_SIZE 

15.5.13  Individual  Amplitude  Cutoff  Lists 

These  cutoff  lists  are  used  to  cutoff  amplitudes  below  a  threshold  value  for  each 
amplitude  type  and  filter  state.  The  cutoff  lists  must  specify  a  cutoff  value  for 
every  channel  in  the  data  file  even  if  it  is  not  going  to  be  analyzed.  The  list  must 
end  with  END. 

Key  Words:  RAW_MAX_AMPLITUDE_CUTOFFS 

LOW_PASS_MAX_AMPLITUDE_CUTOFFS 

HIGH_PASS_MAX_AMPLITUDE_CUTOFFS 

RAW_MIN_AMPLITUDE_CUTOFFS 

LOW_PASS_MIN_AMPLITUDE_CUTOFFS 

HIGH_PASS_MIN_AMPLITUDE_CUTOFFS 

RAW_P2P_AMPLITUDE_CUTOFFS 

LOW_PASS_P2P_AMPLITUDE_CUTOFFS 
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HIGH_PASS_P2P_AMPLITUDE_CUT0FFS 

15.5.14  Example  HVDAWeibullConfiguration.conf 

Figure  25  shows  an  example  Weibull  configuration  file. 

16  Using  MPI 

This  parallelized  computer  software  uses  Message  Passing  Interface  (MPI)  to 
communicate  between  the  various  computers  in  a  cluster  of  computers.  The  user 
must  be  familiar  with  a  few  simple  Linux  command  line  calls  that  enable  and 
maintain  the  MPI  communication  interface.  This  documentation  is  written  for  the 
Local  Area  Multicomputer  (LAM)  implementation  of  MPI.  The  LAM-MPI  com¬ 
munication  software  is  what  allows  the  Linux  cluster  to  perform  calculations  in 
parallel. 

16.1  lamhosts 

Tamhosts’  is  a  file  containing  the  node  names  for  all  of  the  nodes  available  to  the 
MPI  software.  If  a  node  is  not  listed  in  this  file,  you  cannot  use  it  for  calculations. 
The  user  can  append  nodes  to  this  file  from  the  user’s  home  directory  by  typing 
"vi  lamhosts"  from  the  console  or  "gedit  lamhosts"  from  an  X  Windows  terminal. 
This  brings  up  an  editor.  For  ’vi’  usage  information,  type  "man  vi"  at  the  command 
line.  The  order  of  the  node  names  in  this  file  will  determine  the  node’s  number  in 
the  ’mpirun’  call.  The  server  node  MUST  be  listed  first  or  the  program  will  fail. 
The  ’lamhosts’  file  can  be  found  or  created  in  the  user’s  home  directory. 

16.2  recon 

The  ’recon’  command  checks  the  connections  to  the  nodes  in  the  ’lamhosts’  file 
without  actually  bringing  up  the  communications  interface.  The  ’recon’  command 
should  be  run  before  enabling  the  MPI  interface.  Type  "recon  -v  lamhosts".  This 
should  be  done  from  the  user’s  home  directory  or  change  ’lamhosts’  to  be  the  full 
path  name  of  the  lamhosts  file. 
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Sheetl 


OUTPUT_PATH: 

CHANNELS_TO_RUN: 

END 

FILTERS: 

END 

WEIBULL_TYPE- 

AMPUTUDE_TYPE: 

BETA_LOWER_BOUND: 

BETA_UPPER_BOUND: 

BETA_STEP_SIZE: 

SHIPJJFETIME: 

EXTREMES: 

BLANKET  JVMPUTUDE.OJTOFF: 
XNOT_PERCENT_STEP_SIZE: 

RAW.MAXJWPLITUDEJZUTOFFS: 


/server/lest/ 


0 

0 

0 

10 

0 

1 

0.95 

0 


LOW_PASS_MAX_AMPLITUDE_CUTOFFS: 


HIG  H_PASS_M  AX_AMPLITUDE_C  UTOFFS : 

0 

1 

2 

END 

RAW_MIN_AMPUTUDE_CUTOFFS: 

0 

1 

2 


LOW_PASS_MIN_AMPLITUDE_CUTOFFS: 


H IG  H_PASS_MIN_  AM  PLITUDE_C  UT  OFFS: 


END 

RAW_P2P_AMPLITUDE_CUTOFFS: 


LOW_PASS_P2P_AMPLITUDE_CUTOFFS: 


HIGH_PASS_P2P_AMPLITUDE_CUTOFFS- 
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16.3  lamboot 

’lamboot’  is  the  command  that  actually  enables  MPI  communication  between 
computers.  The  number  assigned  to  each  node  can  be  determined  by  looking  at 
the  output  from  this  command.  Type  "lamboot  -v  lamhosts"  when  the  ’lamhosts’ 
file  is  correct  and  the  ’recon’  command  has  completed  successfully.  The  ’lamboot’ 
command  should  be  used  from  the  user’s  home  directory  or  change  ’lamhosts’  to 
be  the  full  path  name  of  the  lamhosts  file. 

16.4  wipe 

’wipe’  stops  MPI  communication  when  the  program  is  complete.  Type  "wipe  -v 
lamhosts"  at  the  command  prompt.  This  should  be  done  from  the  user’s  home 
directory  or  change  ’lamhosts’  to  be  the  full  path  name  of  the  lamhosts  file. 

16.5  lamclean 

’lamclean’  resets  MPI  communication  and  stops  any  runaway  processes  that  are 
trying  to  use  MPI.  This  should  be  done  between  large  data  runs  or  after  the  pro¬ 
gram  has  terminated  in  error.  This  can  be  done  from  any  location  assuming  that 
the  ’lamboot’  command  has  already  been  used  and  MPI  communication  is  still 
active.  Type  "lamclean  -v"  at  the  command  prompt. 

16.6  mpirun 

’mpirun’  is  the  command  that  starts  a  program  that  uses  MPI  in  parallel.  Precede 
the  program  name  with  "mpirun  -v"  followed  by  the  first  and  last  nodes  in  the 
’lamhosts’  file  (for  4  nodes  use  nO-3,  this  uses  nodes  0,1, 2, 3  in  the  ’lamhosts’ 
file).  The  ’mpirun’  command  can  use  any  node  listed  in  the  ’lamhosts’  file.  It  is 
not  required  to  use  all  the  nodes  listed  in  ’lamhosts’.  A  sample  call  to  MPI  using  5 
nodes  would  be  "mpirun  -v  nO-4  program  program_args".  The  ’mpirun’  command 
should  be  used  in  the  folder  containing  the  program  or  configuration  files  to  be 
run.  Another  sample  call  to  MPI  using  all  available  nodes  would  be  “mpirun  -v  C 
program  program_args";  the  “C”  flag  tells  mpirun  to  use  all  available  processors. 
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17  Using  HVDAS 

17.1  General  Setup 

1 .  Make  sure  all  of  your  data  are  backed  up  before  trying  to  setup  anything! 

2.  Make  sure  all  of  your  data  are  backed  up  before  trying  to  analyze  anything! 

3.  Triple  check  your  backups  before  moving  on!  You  have  been  warned. 

4.  Use  Wave  Metrics  IGOR  Pro  Filter  Design  Laboratory,  or  similar  software 
package,  to  design  appropriate  finite  impulse  response  (FIR)  filters  for  your 
specific  data.  You  may  create  up  to  3  different  FIR  filters.  You  may  create 
a  smoothing-pass  filter  to  remove  noise,  a  low-pass  filter  to  remove  high- 
frequency  energy,  and  a  high-pass  filter  to  remove  low-frequency  energy. 

You  may  also  choose  to  box  car  average  your  data  to  remove  drop-outs. 

Look  at  your  data  in  a  package  like  IGOR  to  make  sure  that  your  settings 
make  sense  with  your  current  data  set  and  desired  results. 

5.  Save  the  FIR  filter  coefficients  that  describe  your  filters  in  ASCII  text  files. 
These  coefficients  will  be  pasted  into  the  proper  configuration  files  later. 

6.  Locate  the  file  ’HVDASuite-YYYY-MM-DD.tar.gz’  or  ’HVDASuite.tar.gz’. 

An  ’_i386’  in  the  file  name  indicates  that  this  binary  executable  program 
was  compiled  and  built  for  Intel  i386  based  computer  architecture.  Copy 
this  file  to  a  globally  accessible  working  directory  like  ’/Server/Analysis/’. 
Change  the  working  directory  to  be  that  directory.  Type,  "tar  xvzf  HVDA*.tar.gz", 
to  unpack  the  archive  file.  This  will  create  a  sub-folder,  called  ’HVDA- 
Suite’,  which  will  contain  the  executable  program  ’hvdas’  and  documenta¬ 
tion. 

7.  Type  "./"  to  reference  the  current  directory  in  most  Unix  operating  systems. 

You  will  need  to  add  the  ’./’  before  ’hvdas’  if  you  only  unpacked  the  archive 
and  did  not  install  the  executable  code  into  a  system-wide  accessible  loca¬ 
tion. 

8.  Type  "hvdas  -help"  or  “hvdas  -help”  for  usage  information. 

9.  Make  sure  the  data  on  the  analysis  computer  are  stored  in  a  globally  accessi¬ 
ble  location  if  you  are  going  to  run  the  analysis  on  a  cluster.  It  is  generally  a 
good  idea  to  put  all  of  the  data  conditions  in  a  small  number  of  well-named 
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locations.  See  section  ’One  Valid  Input  Structure’  for  a  complex  data  lay¬ 
out.  The  best  approach  is  to  keep  it  simple.  Each  separate  condition  must 
be  in  a  separate  sub-folder  with  a  unique  name.  The  simplest  layout  is  to 
have  one  main  data  directory  which  contains  one  sub-folder  for  each  of  your 
separate  conditions. 

10.  Create  the  example  configuration  files  ’HVDAGlobalConfiguration.conf’, 
’HVDAMMMConfiguration.conf’,  ’HVDAPSDConfiguration.conf’,  ’HV- 
DARAOConfiguration.conf’,  and  ’HVDAWeibullConfiguration.conf’  by  typ¬ 
ing  “hvdas  -createexampleconfigs”. 

1 1 .  Modify  the  ’HVDAGlobalConfiguration.conf’,  ’HVDAMMMConfiguration.conf’, 
’HVDAPSDConfiguration.conf’,  ’HVDARAOConfiguration.conf,  and  ’HV¬ 
DAWeibullConfiguration.conf’  configuration  files.  The  example  configura¬ 
tion  files  are  well  documented. 

1 2.  Add  an  entry  to  ’HVDAGlobalConfiguration.conf’  in  TEST_CONDITION_LIST 
for  test  condition  folder.  You  will  need  to  change  each  entry  to  reflect  the 
data  contained  in  each  condition  directory.  Make  sure  you  change  CONDI- 
TION_LABEL.  Each  condition  label  MUST  be  unique  or  the  results  will  be 
invalid.  A  well-designed  template  will  not  need  to  be  modified  much  from 
condition  to  condition  if  the  data  is  similar. 

13.  Be  sure  to  paste  all  of  the  FIR  filter  coefficients  and  initial  condition  zero 
values  into  the  ’HVDAGlobalConfiguration.conf’  file.  Also,  be  sure  to  get 
ALL  of  the  data  and  header  formatting  information,  channel  names,  and 
scale  factors  correct  or  the  results  will  be  wrong. 


17.2  Command  Line  Options 

HVDAS  has  several  command  line  options.  These  options  are  very  useful  for 
scripting  large  sets  of  data  to  be  run  over  an  extended  period  of  time.  The  options 
and  flags  can  be  input  in  any  order. 

17.2.1  -help  or  -help 

’hvdas  -help’  or  ’hvdas  -help’  displays  usage  information  and  command  line  op¬ 
tions  to  the  standard  output. 
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17.2.2  -convertdata 

’hvdas  -convertdata’  specifies  that  the  software  should  convert  and  modify  data 
to  ASCII.  This  will  output  converted  or  virtual  channels  to  new  ASCII  files.  Old 
files  will  be  overwritten  without  additional  warning. 

17.2.3  -createexampleconfigs 

’hvdas  -createexampleconfigs’  specifies  that  the  software  should  create  the  ex¬ 
ample  configuration  files  that  are  necessary  to  run  the  desired  analysis  program. 

It  will  create  HVDAGlobalConfiguration.conf,  HVDAMMMConfiguration.conf, 
HVDAPSDConfiguration.conf,  HVDARAOConfiguration.conf,  and  HVDAWeibull- 
Configuration.conf.  Old  configuration  files  will  be  overwritten  if  you  type  ’yes’ 
after  the  warning. 

17.2.4  -mpi 

’hvdas  -mpi’  specifies  that  the  software  should  run  in  MPI  mode.  This  tells  the 
HVDAS  program  to  run  analysis  in  parallel.  The  most  basic  way  to  start  HVDAS 
on  a  cluster  is  ’mpirun  -v  C  hvdas  -mpi  <options>’  to  run  this  program  on  all 
available  nodes;  or  ’mpirun  -v  -np  2  nO  hvdas  -mpi  <options>’  to  run  the  client 
and  server  portions  of  HVDAS  locally,  on  one  singular  node  with  one  or  more 
processors. 


17.2.5  -uni 

’hvdas  -uni’  specifies  that  the  software  should  run  in  uniprocessor  mode.  This 
tells  the  HVDAS  program  to  run  analysis  locally  using  only  one  processor.  The 
most  basic  way  to  start  HVDAS  on  a  single  processor  computer  is  ’hvdas  -uni 
<options>’. 

17.2.6  -mmm 

’hvdas  -mmm’  specifies  that  hvdas  should  perform  MMM  analysis.  This  option 
must  be  used  in  conjunction  with  either  -mpi  or  -uni. 


83 


NSWCCD-65-TR-2003/02 


17.2.7  -psd 

’hvdas  -psd’  specifies  that  hvdas  should  perform  PSD  analysis.  This  option  must 
be  used  in  conjunction  with  either  -mpi  or  -uni. 

17.2.8  -rao 

’hvdas  -rao  specifies  that  hvdas  should  perform  RAO  analysis.  This  option  must 
be  used  in  conjunction  with  either  -mpi  or  -uni. 

17.2.9  -weibull 

’hvdas  -weibull  specifies  that  hvdas  should  perform  Weibull  analysis.  This  option 
must  be  used  in  conjunction  with  either  -mpi  or  -uni. 

17.2.10  -version 

’hvdas  -version’  will  display  version  information. 

17.2.11  -debugoutput 

’-debugoutput’  is  a  flag  that  tells  HVDAS  to  output  extra  textual  information  to 
the  standard  output,  for  debugging  purposes.  The  default  for  this  option  is  false. 

17.2.12  -hvdaglobalconfigurationname 

’-hvdaglobalconfigurationname’  lets  you  specify  the  full  path  name  of  the  global 
configuration  file.  The  default  is  “,/HVDAGlobalConfiguration.conf”. 

17.2.13  -hvdammmconfigurationname 

’-hvdammmconfigurationname’  lets  you  specify  the  full  path  name  of  the  MMM 
configuration  file.  The  default  is  “,/HVDAMMMConfiguration.conf”. 

17.2.14  -hvdapsdconfigurationname 

’-hvdapsdconfigurationname’  lets  you  specify  the  full  path  name  of  the  PSD  con¬ 
figuration  file.  The  default  is  “,/HVDAPSDConfiguration.conf”. 
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17.2.15  -hvdaraoconfigurationname 

’-hvdaraoconfigurationname’  lets  you  specify  the  full  path  name  of  the  RAO  con¬ 
figuration  file.  The  default  is  “./HVDARAOConfiguration.conf”. 

17.2.16  -hvdaweibullconfigurationname 

’-hvdaweibullconfigurationname’  lets  you  specify  the  full  path  name  of  the  Weibull 
configuration  file.  The  default  is  “./HVDAWeibullConfiguration.conf”. 

17.2.17  -logfilename 

’-logfilename’  lets  you  specify  the  full  path  name  of  the  log  file  you  would  like  to 
output.  The  default  is  “./HVDASLog.log”. 

17.2.18  -nofilestats 

’-nofilestats’  tells  HVDAS  that  it  should  not  output  results  files  for  every  single 
input  file.  This  flag  will  restrict  output  to  condition  summary  results  only.  This 
option  is  useful  if  you  have  a  lot  of  data  files  in  each  condition  and  you  do  not  care 
about  the  individual  data  files.  The  default  is  false,  which  means  that  HVDAS  will 
output  individual  file  and  condition  results. 

17.2.19  -nosummarystats 

’-nosummarystats’  tells  HVDAS  that  it  should  not  output  results  files  for  the  con¬ 
dition  summary.  This  flag  will  restrict  output  to  individual  file  results  only.  This 
option  is  useful  if  your  condition  directories  have  only  one  data  file.  The  default  is 
false,  which  means  that  HVDAS  will  output  individual  file  and  condition  results. 

17.2.20  -weibullfilterstate 

’-weibullfilterstate’  lets  you  specify  the  filter  to  use  for  Weibull  analysis  and  will 
override  the  setting  in  the  HVDAWeibullConfiguration.conf  configuration  file. 

17.2.21  -weibullamplitudetype 

’-weibullamplitudetype’  lets  you  specify  the  set  of  amplitudes  to  use  for  Weibull 
analysis  and  will  override  the  setting  in  the  HVDAWeibullConfiguration.conf  con¬ 
figuration  file. 


85 


NSWCCD-65-TR-2003/02 


17.3  Cluster  Execution 

1 .  Type:  "hvdas  -help"  for  usage  information. 

2.  Warning:  Old  results  in  the  results  output  path  will  be  overwritten  without 
warning! 

3.  Triple  check  your  results  output  path  to  make  sure  you  are  not  going  to 
overwrite  anything  important!  You  have  been  warned. 

4.  Go  to  the  home  directory  "cd 

5.  Edit  ’lamhosts’  if  necessary  "vi  lamhosts". 

6.  Recon  ’lamhosts’  Type  "recon  -v  lamhosts"  to  see  if  the  cluster  is  boot-able. 

7.  If  ’recon’  is  successful,  bring  up  MPI  using  "lamboot  -v  lamhosts". 

8.  If  ’lamboot’  is  successful,  go  to  the  analysis  directory  where  the  HVDAS 
configuration  files  are  located.  For  example:  Type  “cd  /server/test/”. 

9.  If  all  the  configuration  files  are  set  up  and  ’lamboot’  worked,  run  the  pro¬ 
gram:  "mpirun  -v  C  hvdas  -mpi  <options>",  which  will  actually  perform 
the  desired  analysis.  Adjust  the  “C”  to  “nO-5”  to  use  a  smaller  subset  of 
available  nodes.  In  one  example  case,  6  computers  are  in  the  ’lamhosts’ 
file,  0  is  the  server  and  1  through  5  are  the  compute  nodes,  so  specifying 
“C”  is  exactly  the  same  as  specifying  “nO-5”.  You  may  optionally  run  ’hv¬ 
das  -convertdata’  to  smooth,  filter,  scale,  zero,  or  reformat  your  input  data 
files  and  save  them  in  new  ASCII  tab-delimited  text  data  files. 

1 0.  To  perform  MMM  analysis  run  “mpirun  -v  C  hvdas  -mpi  -mmm  -logfilename 
mmmlog.log”. 

1 1 .  To  perform  PSD  analysis  run  “mpirun  -v  C  hvdas  -mpi  -psd  -logfilename 
psdlog.log”. 

12.  To  perform  RAO  analysis  run  “mpirun  -v  C  hvdas  -mpi  -rao  -logfilename 
raolog.log”. 

1 3.  To  perform  Weibull  analysis  run  “mpirun  -v  C  hvdas  -mpi  -weibull  -logfilename 
weibulllog.log”. 

14.  If  errors  are  reported,  fix  and  rerun. 
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15.  When  program  has  completed,  clean  MPI  "lamclean  -v". 

1 6.  The  MMM  analysis  results  should  be  in  the  Vserver/test/HVDAMMMResults/’ 
folder  in  the  location  chosen  in  the  ’HVDAMMMConfiguration.conf’  file. 
The  converted  or  modified  data  files  should  be  in  the 
Vserver/test/HVDAConvertedOutputData/’  folder  in  the  same  location  cho¬ 
sen  in  the  ’HVDAMMMConfiguration.conf’  file. 

17.  If  another  analysis  is  desired,  change  the  necessary  settings  and  rerun,  oth¬ 
erwise  shutdown  MPI  from  the  home  directory  using  "wipe  -v  lamhosts". 

1 8.  If  everything  worked  properly,  you  should  see  messages  telling  you  that  ev¬ 
erything  finished  properly.  You  should  see  the  elapsed  time  and  the  location 
of  the  results. 

19.  A  log  file  called  ’HVDASLog.log’  should  have  been  generated  unless  the  - 
logfilename  option  was  used.  This  log  file  contains  debugging  information, 
analysis  information,  progress  information,  and  error  information.  It  is  a 
good  idea  to  check  this  file  to  make  sure  everything  went  as  planned  and  to 
check  for  errors. 

20.  Check  the  results  output  folder.  The  ’HVDA*Results/’  folder  should  con¬ 
tain  one  sub-folder  for  each  input  condition.  Check  these  folders  for  indi¬ 
vidual  output  files  and  condition  summaries.  The  output  is  standard  ASCII 
tab  delimited  text,  which  can  be  imported  into  almost  any  spreadsheet  and 
by  any  ASCII  text  editor. 

21.  It  is  a  good  idea  to  manually  check  the  results  for  three  or  more  channels, 
two  or  more  filter  states,  in  three  or  more  conditions  to  ensure  good  output. 

22.  If  you  got  good  results,  back  them  up! 

23.  Back  up  your  results!  You  have  been  warned. 

17.4  Workstation  (Single  Processor)  Execution 

1.  Type:  "hvdas  -help"  for  usage  information. 

2.  Warning:  Old  results  in  the  results  output  path  will  be  overwritten  without 
warning! 
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3.  Triple  check  your  results  output  path  to  make  sure  you  are  not  going  to 
overwrite  anything  important!  You  have  been  warned. 

4.  Go  to  the  analysis  directory  where  the  HVDAS  configuration  files  are  lo¬ 
cated.  For  example:  Type  “cd  /server/test/”. 

5.  To  perform  MMM  analysis  run  “hvdas  -uni  -mmm  -logfilename  mmm- 
log.log”. 

6.  To  perform  PSD  analysis  run  “hvdas  -uni  -psd  -logfilename  psdlog.log”. 

7.  To  perform  RAO  analysis  run  “hvdas  -uni  -rao  -logfilename  raolog.log”. 

8.  To  perform  Weibull  analysis  run  “hvdas  -uni  -weibull  -logfilename  weibul- 
llog.log”. 

9.  To  perform  data  conversion  run  “hvdas  -convertdata  -logfilename  convert- 
log.log”. 

10.  If  errors  are  reported,  fix  and  rerun. 

1 1 .  The  MMM  analysis  results  should  be  in  the  ’/server/test/HVDAMMMResults/’ 
folder  in  the  location  chosen  in  the  ’HVDAMMMConfiguration.conf’  file. 
The  converted  or  modified  data  files  should  be  in  the 
Vserver/test/HVDAConvertedOutputData/’  folder  in  the  same  location  cho¬ 
sen  in  the  ’HVDAMMMConfiguration.conf’  file. 

1 2.  If  another  analysis  is  desired,  change  the  necessary  settings  and  rerun. 

1 3.  If  everything  worked  properly,  you  should  see  messages  telling  you  that  ev¬ 
erything  finished  properly.  You  should  see  the  elapsed  time  and  the  location 
of  the  results. 

14.  A  log  file  called  ’HVDASLog.log’  should  have  been  generated  unless  the  - 
logfilename  option  was  used.  This  log  file  contains  debugging  information, 
analysis  information,  progress  information,  and  error  information.  It  is  a 
good  idea  to  check  this  file  to  make  sure  everything  went  as  planned  and  to 
check  for  errors. 

15.  Check  the  results  output  folder.  The  ’HVDA*Results/’  folder  should  con¬ 
tain  one  sub-folder  for  each  input  condition.  Check  these  folders  for  indi¬ 
vidual  output  files  and  condition  summaries.  The  output  is  standard  ASCII 
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tab  delimited  text,  which  can  be  imported  into  almost  any  spreadsheet  and 
by  any  ASCII  text  editor. 

16.  It  is  a  good  idea  to  manually  check  the  results  for  three  or  more  channels, 
two  or  more  filter  states,  in  three  or  more  conditions  to  ensure  good  output. 

17.  If  you  got  good  results,  back  them  up! 

18.  Back  up  your  results!  You  have  been  warned. 

17.5  Viewing  Results 

17.5.1  Importing  ASCII  Text  Files  Into  a  Spreadsheet 

A  great  way  to  look  at  the  result  files  from  HVDAS  is  with  a  spreadsheet  program 
such  as  Microsoft  Excel,  Sun  Microsystems  Star  Office,  or  Open  Office.  Try 
to  open  the  result  file  as  an  ASCII  text  file  or  Comma  Separated  Value  (CSV) 
text  file.  Most  spreadsheet  programs  will  allow  you  to  select  some  options  to 
describe  the  text  file.  Make  sure  that  you  select  a  Tab  character  as  the  separating 
or  delimiting  character  if  it  is  not  the  default. 

17.5.2  Printing  ASCII  Text  Files  From  Linux/UNIX 

1 .  Go  to  the  directory  containing  the  data  to  be  printed. 

2.  Type:  "a2ps  -landscape  -columns  1  -rows  1  -f  8  -d  Output.txt"  or  open  the 
results  in  a  spreadsheet  program  and  print  from  there. 

•  Option  ’-landscape’  Sets  the  orientation  of  the  printed  page 

•  Option  ’-columns’  Sets  the  number  of  pages  to  print  vertically  per-page 

•  Option  ’-rows’  Sets  the  number  of  pages  to  print  horizontally  per-page 

•  Option  ’-f’  Sets  the  font  size,  8  in  this  example 

•  Option  ’-d’  Precedes  the  file  name  to  print 

•  The  file  name  can  include  *’s  to  print  multiple  files  at  once. 

•  The  output  results  files  are  tab  delimited  and  may  be  imported  into  various 
spreadsheets  easily. 
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17.5.3  Using  gnuplot  to  View  Data 

1 .  Go  to  the  directory  containing  the  data  to  be  printed. 

2.  Type:  “gnuplot”  to  start  the  gnuplot  command  interpreter  or  type:  “gnuplot 
scriptfile.gnuplot”  to  have  gnuplot  read  commands  from  a  text  file. 

3.  gnuplot  can  read  ASCII  text  data  files  if  all  of  the  header  lines  begin  with 
“#”  comment  characters 

4.  Command:  “plot  "Data_mod_0.txt"  using  1  title  ’ASDSD19S38ch  1’  with 

lines,  "smooth  1  .txt’'  using  1  with  lines  lw  3“  will  plot  channel  1  from  Data_mod_0.txt 
using  lines,  and  channel  1  from  smoothl.txt  using  lines  with  line  width  of 
3. 

5.  Command:  “set  out  "pstest.ps"”  will  set  the  output  file  to  “pstest.ps” 

6.  Command:  “set  size  1 .0,  0.5”  will  set  the  size  of  the  output  plot 

7.  Command:  “set  terminal  postscript  landscape  enhanced  "Helvetica"  12” 
will  set  the  type  of  output,  font,  and  font  size 

8.  Steps  to  print  out  plots  on  paper: 

•  set  size  1 .0,  0.5 

•  set  terminal  postscript  landscape  enhanced  "Helvetica"  12 

•  !rm  -f  pstest.ps 

•  set  out  "pstest.ps" 

•  plot  "Data_mod_0.txt"  using  1  title  ’ASDSD1 9S38ch  1  ’  with  lines,  "smoothl  .txt" 
using  1  with  lines  lw  3 

•  llprpstest.ps 
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